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INTRODUCTION* 


CARLYLE F, JACOBSEN 


State University of lowa 


The members of this panel have ad- 
dressed themselves to various aspects of 
and problems relating to community men- 
tal health services. Under the provisions 
of the National Mental Health Act passed 
by the Congress in 1946, a major fraction 
of the funds appropriated are distributed 
among the states for use at the state level 
in establishing and encouraging commu- 
nity mental health activities. This is a 
bold undertaking and one that is rich with 
opportunities for psychology and the men- 
tal health team, as well as one that pre- 
sents many unresolved problems. 

Our traditional approach to the task of 
improving mental health in our communi- 
ties has focused on the individual, his 
problems and perplexities. Treatment 
has necessarily and wisely had its primary 
orientation toward helping the individual 
to meet his problems more adequately and 
to live more comfortably in his relations 
to his family, the school, his church, his 
job and the community. Since the pas- 
sage of the Mental Health Act, many com- 
munities throughout the country have 
established new clinics or strengthened 
existing facilities to make this type of 
treatment more readily available to its 
citizens. With these undertakings have 
arisen such questions as: What is the 
most effective way of helping a community 


* Chairman’s Introduction to a Symposium on 
Psychology in the Field of Community Services, 
American Psychological Association, Division 
of Clinical and Abnormal Psychology, Denver, 
Colorado, September 6, 1949. 


to appreciate the need for better mental 
health services? How can such desire be 
translated into action establishing ade- 
quate mental health services, and finally, 
what steps can be taken to assure their 
continuing growth and, success in serving 
the people ? 

Our thinking has traditionally been 
centered about the individual, and treat- 
ment has been so oriented, but what of a 
positive, preventive program in the men- 
tal health field? From time to time men- 
tal health workers in the schools, com- 
munity clinics, community social service 
agencies and the courts have been con- 
cerned with a broader approach, looking 
toward the prevention of mental ill- 
health as well as its treatment. With 
proper regard for such pioneer efforts, we 
must still recognize that we do not have 
an effective preventive program in the 
field of mental health. It is an oppor- 
tunity for research, an opportunity which, 
if accepted and acted upon, can yield 
enormous dividends to our country. A 
positive mental health program offers our 
greatest opportunity, and confronts us 
with the most difficult task in the entire 
mental health field. Certainly the psy- 
chologist as a member of the mental 
health team, must be prepared to accept 
his full responsibility for research and 
development of new techniques and new 
concepts. 

It is to selected facets of these oppor- 
tunities and tasks that our speakers this 
morning have directed their attention. 
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THE COMMUNITY SERVICES PROGRAM OF THE NATIONAL 
INSTITUTE OF MENTAL HEALTH, U. S. PUBLIC 
HEALTH SERVICE* 

JERRY W. CARTER, JR., PH.D. 


Chief Clinical Psychologist, Community Services Branch, National Institute of 


Mental Health, U. 


Following World War II, congres- 
sional hearings revealed that various men- 
tal and emotional disorders and inade- 
quacies accounted for the rejection or 
discharge of 2,000,000 men by the armed 
services. Moreover, despite the large 
number screened out before induction, 
mental disorders among veterans ac- 
counted for as much as a third of all 
pensionable disabilities and over one half 
of hospitalizations in the Veterans Ad- 
ministration. Concern over this cost to 
the nation in manpower losses and vet- 
eran care led Congress to study the men- 
tal health problems and needs of the 
country. 

It was found that more than half of the 
patients hospitalized in the United States 
on any given day—some 600,000—were 
mental patients, and that about 8,000,000 
individuals in the country were suffering 
from some mental disorder. No adequate 
programs for the prevention and early 
treatment of mental illness existed any- 
where in the country. There were 
thought to be about 600 out-patient men- 
tal health clinics in the country against a 
minimum need for 1,400. Five states 
were without any public or private men- 
tal health services outside of state hos- 
pital care. The foremost authorities in 
the country testified that the total num- 
ber of all the psychiatrists, clinical psy- 
chologists, psychiatric social workers, and 
psychiatric nurses in the country amount- 
ed to only about 12,000 individuals, or 
considerably less than the minimum num- 
ber needed in any one of the four disci- 
plines ; that training facilities were ade- 
quate to train only a small fraction of the 
needed personnel ; and that the skills and 
scientific knowledge required to attack 

* Presented at the meetings of the American 
Psychological Association, Denver, Colorado, 
September 6, 1949, in the Division of Clinical 
and Abnormal Psychology’s Symposium on 
Psychology in the Field of Community Services. 


S. Public Health Service 


seriously the mental health problem on a 
nationwide basis were wholly inadequate. 

To help remedy this situation, Congress 
passed the National Mental Health Act in 
July 1946. The legislation gave the Sur- 
geon General of the Public Health Serv- 
ice responsibility for developing a broad 
program to improve the mental health of 
the nation through: (1) training mental 
health personnel; (2) research in the 
problems of mental illness; and (3) de- 
velopment by the States of preventive 
mental health programs in their communi- 
ties. 

This program is administered by the 
National Institute of Mental Health, one 
of the National Institutes of Health of 
the Public Health Service. The major 
objectives of the program are: (1) to de- 
velop economical methods of bringing 
mental health care to persons in need of 
such assistance; (2) to develop preven- 
tive and control methods in the mental 
health field; and (3) to promote positive 
mental health. 

A National Advisory Mental Health 
Council consisting of leading scientific 
and medical authorities is provided for in 
the National Mental Health Act. This 
body advises the Surgeon General on such 
matters as policy, the distribution of 
grant funds, personnel standards, and 
other problems relating to the program. 
The present members of the Council are: 
Dr. Franz Alexander, Dr. Leo H. Barte- 
meier, Dr. Karl M. Bowman, Dr. Alan 
Gregg, Dr. S. Bernard Wortis, and our 
symposium chairman, Dr. Carlyle Jacob- 
sen. Assisting the Council are commit- 
tees on community services, research, and 
training. The Training Committee has 
four subcommittees in each of the follow- 
ing fields: clinical psychology, psychiatry, 
psychiatric social work, and psychiatric 
nursing. The research committee is like- 
wise multidisciplinary including repre- 
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sentatives from the various medical, bio- 
logical and social sciences. On the Com- 
munity Services Committee are repre- 
sentatives of the general public as well as 
the mental health professions. In addi- 
tion, the Institute has several panels of 
consultants which advise on scientific and 
professional matters, program planning, 
and special problems. In brief, every ef- 
fort is made to use the best advisory and 
consultant resources available. 

The National Institute of Mental 
Health is directed by Dr. Robert H. Felix 
and consists of the following branches: 
the Training and Standards Branch, the 
Research Projects Branch, the Biometrics 
Branch, the Publications and Reports 
Branch, and the Community Services 
3ranch, all operating on an interdisciplin- 
ary basis. 

The Training and Standards Branch of 
the Institute administers grants for im- 
proving and expanding graduate training 
in the fields of psychiatry, clinical psy- 
chology, psychiatric social work, and psy- 
chiatric nursing; stipends to trainees in 
the above four mental health disciplines ; 
and grants to medical schools for under- 
graduate instruction in psychiatry. In the 
current fiscal year, $2,500,000 are available 
for graduate training grants and stipends 
and $400,000 for undergraduate psychia- 
tric training in medical schools. Other 
training activities include demonstrations 
in professional education and conferences 
to improve teaching methods, such as the 
Boulder Conference on Graduate Educa- 
tion in Clinical Psychology held August 
20 to September 3, 1949. 

The research program of the National 
Institute of Mental Health is divided into 
research grants and intramural research 
projects. Grants-in-aid for research are 
made to universities and other public or 
private institutions and to individuals for 
research in mental health on the etiology, 
diagnosis, treatment,-control, and preven- 
tion of mental diseases. Projects are 
supported from a wide range of disci- 
plines and are not confined to any one 
field. In addition, fellowships are pro- 
vided for the training of promising re- 
search workers, in any relevant discipline, 
who are interested in mental health. In 
this fiscal year, $800,000 will be available 
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for research grants and $100,000 for re- 
search fellowships. Since this program 
has been in operation for three years and 
since many projects run from three to 
five years and many fellowships are re- 
newed beyond the initial year, only a 
fraction of the above amounts will be 
available for new grants and fellowships 
during the year. The intramural re- 
search program is still in its initial stages 
of development and will entail a major 
interdisciplinary research program with 
its focal point at the Clinical Center now 
under construction at Bethesda, Mary- 
land, 

In addition to these research activities, 
the Biometrics Branch of the Institute 
compiles and evaluates statistics on pa- 
tients in mental hospitals and other re- 
lated problems, functions which were 
taken over from the Bureau of the Cen- 
sus in 1948. The Publications and Reports 
Branch is responsible for the planning, 
production and dissemination of informa- 
tion about mental health. 

The program of the Community Serv- 
ices Branch is one of assistance to States 
in devéloping their own community men- 
tal health programs based upon local 
needs, resources, and problems. The ex- 
pectation is that, with 53 States and Ter- 
ritories developing their own local men- 
tal health programs, the more successful 
patterns of outpatient, preventive, and 
positive mental health services will emerge 
for more widespread use throughout the 
country. In other words, this program 
is in the Public Health Service tradition, 
of encouraging the development of strong 
and independent local and State health 
resources rather than developing a large 
nationally integrated program and of em- 
phasizing the control and prevention of 
disease rather than its treatment. 

Prior to this assistance program, which 
began operation in July 1947, only 22 
States had mental health programs. At 
present all but two of the 53 States and 
Territories are participating in the com- 
munity services program. Grants to 
States available in this fiscal year total 
$3,550,000. The States are required to 
match one dollar of State and local money 
for each two dollars of Federal funds re- 
ceived and to submit a plan and budget 
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annually for the use of these funds. 
They may use funds for any mental 
health purpose they decide upon except 
institutional care. In the fiscal year end- 
ing June 30, 1949, the States budgeted 51 
per cent for their mental health funds for 
the establishment, improvement, or ex- 
pansion of mental health clinics; 15 per 
cent for preventive and educational ac- 
tivities ; 11 per cent for professional serv- 
ices other than clinic services ; 10 per cent 
for training mental health personnel; 11 
per cent for central administration ; and 2 
per cent for special studies. 

In addition to administering grants to 
States, the Community Services Branch 
provides professional and technical plan- 
ning, development, coordination, and gen- 
eral direction in the assistance-to-States 
program. These activities are carried on 
through ten regional offices by 17 mental 
health consultants in psychiatry, clinical 
psychology, psychiatric social work, and 
mental health nursing. In so far as pos- 
sible, each Regional Office is to be staffed 
with complete teams of mental health con- 
sultants in all four of these disciplines. 
In addition, the Branch operates and di- 
rects demonstration projects to try out 
new and better methods and techniques 
of rendering community mental health 
services for use by States in developing 
their local programs. The Branch also 
maintains laison with other governmen- 
tal and non-governmental agencies con- 
cerned with mental health problems, con- 
ducts comprehensive on-the-spot surveys 
of existing and projected State mental 
health facilities, and provides, upon re- 
quest, consultative services to mental 
hospitals and institutions. 

The mental health consultants in psy- 
chiatry, clinical psychology, psychiatric 
social work, and mental health nursing 
assigned to regional offices carry out the 
assistance-to-States program by main- 
taining liaison with State and local men- 
tal health authorities, professional groups, 
universities, and other institutions ; by re- 
viewing State mental health programs ; 
and by recommending action on State 
mental health grant-in-aid plans and 
budgets. Their chief objective is to as- 


sist the States to develop community men- 
tal health programs which will: (1) de- 
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termine mental health needs and resources 
as a basis for planning a comprehensive 
and adequate State mental health pro- 
gram; (2) establish an organization with 
responsibility and authority for the pro- 
gram; (3) develop public interest and re- 
sponsibility for meeting the mental health 
needs of the people in the State; (4) 
furnish mental health information and 
encourage the application of available 
mental health knowledge by the public ; 
(5) provide special opportunities for 
mental health education and training for 
physicians, teachers, nurses, social work- 
ers, clergymen, and others whose daily 
work may have a preventive and positive 
mental health influence on appreciable 
numbers of people; (6) provide educa- 
tional services for the development of 
well-adjusted children and adults; (7) 
provide professional services to infants, 
children, and adults who have behavior, 
educational, vocational, personality, © or 
social difficulties which interfere with 
their functioning to the limit.of their 
abilities and with their personal and _ so- 
cial adjustment in life; (8) support or 
conduct studies which will increase 
knowledge and make possible a_ better 
understanding and handling of behavior 
problems; and (9) increase the number 
and competence of psychiatrists, psy- 
chologists, psychiatric social workers, and 
mental health nurses qualified for work in 
community mental health programs by 
establishing and supporting service facili- 
ties in cooperation with training centers 
and by supporting the training of par- 
tially qualified mental health personnel. 

The success of community mental 
health programs over the country will 
depend on the knowledge, methods, skills, 
and the quality and quantity of personnel 
the several mental health disciplines de- 
velop and bring to bear upon the mental 
health problems of diagnosis, treatment, 
prevention, and ways of promoting posi- 
tive mental health. The mental health 
field is so large and the needs are so great 
that all the mental health disciplines will 
have to supplement each other’s effort and 
extend themselves to the utmost if any 
real progress is made toward improving 
the mental health of the nation. 

Consider the magnitude of the prob- 





COMMUNITY SERVICES PROGRAM 


lem. Mental illness is prevalent in all 
communities, among children and adults 
and in every level of society. Moreover, 
it may be as malignant as a cancer or as 
mild as a cold. It is conservatively esti- 
mated that in the United States at least 
one person in twenty will be hospitalized 
for mental illness at sometime in his life 
and that at least one individual out of five 
will fall into some category of serious but 
less acute behavior disorders such as those 
often associated with criminality and de- 
linquency, accident proneness, divorce, 
economic dependency, and other individ- 
ual failures in the performance of major 
social and personal roles. The annual 
cost of handling behavior disorders and 
the loss in earning power and productivity 
in the communities of this country are 
calculated in billions of dollars, but the 
more important intangible costs in hu- 
man misery and frustration, in disrupted 
homes, in children deprived of security, 
happiness and normal opportunities can- 
not be calculated. The urgency of this 


problem is further heightened by the fore- 


cast of an increase in behavior disorders 
out of proportion to the population in- 
crease unless something is done, because 
the incidence of mental disorders in- 
crease with age and the number of Ameri- 
cans aged 65 and over is expected to 
double in the period 1940 to 1975. 

To meet these needs for community 
mental health services there are some 
5,000 psychiatrists in the country, but 
probably not more than 2,000 engage in 
outpatient work, private practice, and 
other kinds of services at the community 
level. Of the 7,000 psychologists we 
have, there are probably not more than 
1,000 in the community services field. Of 
approximately 1,200 psychiatric — social 
workers, only around 800 work in com- 
munity mental health. Of the 5,600 
graduate nurses working in the mental 
health field, probably less than 50 are 
working in the community mental health 
field. Accordingly, in all the mental 
health disciplines there are probably not 
more than 3,800 individuals, including 
many working only part time, to serve the 
millions needing community mental health 
services. 

As one of the mental health disciplines, 
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psychology has unique and major oppor- 
tunities and responsibilities for research, 
training, and service in the community 
mental health field that have scarcely been 
touched. 

From the standpoint of psychological 
research, consider the present state of 
knowledge concerning the etiology, treat- 
ment, and prevention of mental illness and 
what we know about positive mental 
health or the principles which will insure 
mental health. The diagnosis and treat- 
ment of mental disorders at best is only 
in its early adolescence. Prevention is 
just a toddler and positive mental health 
is little more than a gleam in the eyes of 
the National Institute of Mental Health 
and a few individuals like Daniel Pres- 
cott and Ralph Ojeman with their mental 
health through education programs, Leo 
Bartemeier with his Cornelian Corners, 
Lloyd Rowland with his Pierre The Peli- 
can for parents with their first baby and 
Edmund H. Bullis with his Human Rela- 
tions in the Classroom. Our best devel- 
oped community mental health resources 
are our clinics with their multidisciplinary 
or team approach and the various uni- 
disciplinary services such as those ren- 
dered by psychologists, psychiatrists, and 
psychiatric social workers. Perhaps the 
most that can be said for these resources 
is that they are limited primarily to the 
early diagnosis and treatment of behavior 
disorders acute enough to be referred to 
them. Their work is preventive mainly 
in the sense that they attempt to prevent 
even more serious developments which 
might otherwise lead to institutionaliza- 
tion. Very few of these clinics and pro- 
fessional services attempt much in the 
way of prevention at the sub-clinical level 
and practically none do more than make 
occasional verbal gestures toward positive 
mental health, so great is the demand for 
all available clinical services and so great 
the lack of knowledge and skills in how 
to do preventive and positive mental 
health work. Unanswered are such ques- 
tions as: What are the major kinds of 
mental ill health and in what segments of 
the population are they found? What 
are the factors underlying mental health 
and mental ill health? What specific men- 
tal health services are needed? How 
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should we go about meeting these needs? 
The answers to these questions will re- 
quire research on the basic problems of 
behavior development; on the nature, 
etiology, and treatment of behavior dis- 
orders; on the development of mass 
screening and treatment techniques; on 
community life, its attitudes, cultural 
mores, problems, needs, resources, and 
potentialities ; and on a host of other re- 
lated problems, all of which are proper 
concerns of psychology in some degree. 

Upon such researches as these will de- 
pend ultimately the answer to the ques- 
tion—what should be the preparation of 
clinical psychologists for work in the com- 
munity mental health field? As we now 
know it, however, the demand is for well- 
qualified. psychologists able to assume 
positions of professional responsibility 
and leadership and with enough knowl- 
edge of related professions and of the or- 
ganization and dynamics of communities 
to recognize, use, and help develop po- 
tential mental health resources in the com- 
munity. Beyond this, clinical psycholo- 
gists working in this field, as in other 
fields, should be able to formulate a psy- 
chological diagnosis as a basis for treat- 
ment planning, participate in treatment 
planning,. and carry out treatment plans 
either by providing consultation for oth- 
ers doing remediation or by executing di- 
rect treatment measures with consulta- 
tion or supervision as may be needed. 
Training and experience for work with 
infants, children, and adults are also es- 
sential. In brief, the need in this field is 
for clinical psychologists who are inter- 
ested primarily in extending the applica- 
tion of mental health principles involved 
in a given case to similar types of cases 
and in contributing as much as possible to 
positive mental health. 

Concerning the need for clinical psy- 
chologists in the community mental health 
field, there is probably not a rural or ur- 
ban community of 100,000 people in the 
country that is not in urgent need of a 
community clinic with at least one staff 
member from each of the four mental 
health disciplines, to say nothing of the 


needs for psychological services in schools, 
and other health, welfare, and social in- 


stitutions. There is an immediate need 
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in this field for a minimum of 1,500 clini- 
cal psychologists. Long-range estimates 
of needs far exceed these modest esti- 
mates and make community services po- 
tentially the largest field of employment 
for psychologists. 

Study of data published recently by 
Wolfle and Black in the American Psy- 
chologist and unpublished data collected 
by Limburg reveals that of some 7,000 
known psychologists in the United States 
there are probably only 2,000 in the clini- 
cal and other closely related fields of psy- 
chological services, with around 1,800 ad- 
ditional individuals in training. Between 
900 and 1,000 of these 2,000 are esti- 
mated to be engaged in some type of com- 
munity services work such as in clinics, 
schools, and other community organiza- 
tions. Probably very few of those now 
being trained in clinical psychology are 
receiving adequate preparation or even 
orientation for work in the community 
services field. Whereas about 60% of the 
APA membership have completed their 
training for a doctorate in psychology, 
only about one-third of the psychologists 
now in the community services field have 
such training. As a group they receive 
the lowest salaries in the several occupa- 
tional groups in psychology. Because of 
lower salaries and lesser status than other 
psychologists enjoy, psychologists in com- 
munity services either have had less en- 
couragement to complete their training 
or the field has not been able to attract 
better trained psychologists. This is a 
serious situation because outpatient work 
or work in open-ended settings like com- 
munity services requires at least as high 
if not a higher degree of competence than 
is required in closed or institutional sys- 
tems. For instance, in closed systems 
like hospitals, errors of omission or com- 
mission are more readily righted by super- 
visors than they are in open-ended or out- 
patient settings where patients are not 
under control. Also, the variety of pa- 
tients and problem situations are greater 
in the community services field and re- 
quire relatively more extensive if not 
more intensive skills. The need in this 
field is for better-qualified psychologists 
who can render more adequate commu- 
nity mental health services on a profes- 
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sional rather than a technical or clinically 
useful level. With more status and an 
improved salary situation, more and bet- 
ter psychologists should be attracted to 
this field. Needless to say, the National 
Institute of Mental Health is encouraging 
just these things in its assistance-to- 
States program and making every effort 
to break the impasse that has prevented 
greater contributions from clinical psy- 
chology to the community services field. 
While the Public Health Service has al- 
ways been interested in mass services, it 
has never been interested in quantity at 
the expense of quality. Rather, in its 
long history it has found in comparable 
situations that the argument “something 
is better than nothing” may be a danger- 
ous iallacy, especially if the “something,” 
such as inadequate personnel, operates to 
spoil opportunities and make for failures. 
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All.too often, after such failures, areas 
have to lie fallow, sometimes for many 
years, before another attempt can be 
made. 

In conclusion, the opinion is hazarded 
that if psychology supplies its share of 
the research and the personnel needed in 
the community mental health program, its 
success will have important implications 
for: all fields of psychology. All psy- 
chologists are invited to consider their 
responsibilities and opportunities in the 
community services field, regardless of 
whether their principal interests be in 
systematic, experimental, animal, social, 
genetic, educational, clinical, or any other 
field of psychology. Contributions from 
all fields of psychology are needed and 
all psychologists will find some problem 
in the community mental health program 
worthy of their attention. 
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The clinical psychologist working in the 
traditional setting of the clinic or hospital 
is accustomed to having his cases brought 
to him in his own office where he usually 
works with them on an individual basis. 
Feeling secure in his own setting, he rec- 
ognizes the need for helping others to feel 
comfortable “about coming to see a psy- 
chologist.” In community service work, 
on the other hand, the psychologist is fre- 
quently called upon to work in settings 
which are not familiar to him, and conse- 
quently needs to develop a comfortable 
feeling himself before he is able to help 
others feel at ease. In order to feel com- 
fortable and to function effectively in 
physical health clinics, social agencies, 
schools and other community agencies, 

* Presented at the meetings of the American 
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the psychologist needs to understand the 
structure of community organization. In- 
stead of having people seek him out after 
problems have developed, he will have an 
opportunity to observe them in what ap- 
proaches a normal situation. 

Another way in which community work 
differs from work in the usual clinic set- 
ting is that the psychologist associates 
with different groups of workers. Most 
clinical psychologists have worked only 
with psychiatrists and social workers 
whose approach to problems is similar to 
theirs. In the field of community services, 
the psychologist works with members of 
many other professions; for example, the 
clinic nurse, the case worker, the teacher 
in the nursery, and the public school—all 
of whom have a background of training 
and experience quite different from his 
own. The fact that they may feel inade- 
quate in meeting problems of social agd 
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emotional adjustment, may make them 
feel threatened when the psychologist 
enters their domain. Although some psy- 
chologists have worked with all of these 
groups, in most instances, they have 
worked with them apart from the medical 
clinic, the social agency, or the classroom. 
When the psychologist works in their set- 
ting, rather than his own, he must build 
a cooperative working relationship which 
will help them to gain a better understand- 
ing of some of the mental health aspects 
of their work and to develop more effect- 
tive methods of dealing with mental and 
emotional problems. 

In regard to both the new types of 
situations and to the new groups of work- 
ers, it is suggested that the psychologist 
would do well to assume the role of 
“listener and learner.” This will give the 
workers a feeling of security by making 
them realize that he is interested in learn- 
ing more about their problems. It will 
also help him to gain a better understand- 
ing and appreciation of the situations that 
confront them. In reality, the psycholo- 
gist will not be assuming a pose when he 


adopts this role, for if there is anything 
about which we can feel quite definitely, 
it is that we do not “know the answers” 


in this field. We have much to learn 
about helping people to meet problems of 
living in such a way that serious malad- 
justment, if not illness, will be prevented. 
Unless the psychologist or any other 
worker in the mental health field can help 
members of related professions feel com- 
fortable in their mutual relationships, few 
constructive results can be expected. 
Workers in the mental health field un- 
doubtedly have felt that they were ex- 
pected either to know or to find out the 
answers. Consequently when they enter 
a new situation, they tend to give others 
the feeling that they will have all the an- 
swers. Not until we ourselves feel, and 
in turn help others feel, that we are work- 
ing with them rather than for them, can 
we hope to gain acceptance. 

Since other workers in the community 
often have rather vague concepts of the 
mental health specialties, they are apt to 
confuse their functions. If the psycholo- 
gist is also confused, the situation will be 
all the more complicated. In the com- 
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munity service field, it is even more im- 
portant than in the clinical field that the 
psychologist have an understanding of the 
special functions and contributions of the 
closely allied disciplines of psychiatry, 
psychiatric social work and mental health 
nursing. 

Opportunities for the psychologist to 
do preventive work lie in three principal 
groups of community organizations — 
health agencies, public and private social 
welfare agencies, and educational institu- 
tions. Each community has a somewhat 
different type of organization, so situa- 
tions will vary from one community to 
another, but the following are sufficiently 
typical to illustrate the preventive ap- 
proach. 

One of the best foci of attention is the 
pre-natal clinic. Many of the expectant 
mothers who come to a pre-natal clinic do 
not have resources for other medical and 
psychological assistance, and may not 
have read extensively about the normal 
growth and development of children. 
They are usually seen briefly by the pub- 
lic health nurse and/or clinic nurse and 
then wait for the clinic doctor. This wait- 
ing period provides a good opportunity to 
talk with them in small groups and to an- 
swer questions they may have about the 
coming of a new child. Classes or dis- 
cussion groups organized especially for 
expectant parents afford other opportuni- 
ties to the psychologist. Since these 
groups are made up of essentially normal 
individuals with normal problems, mem- 
bers of the group will frequently give the 
right answers to problems or situations 
which are discussed. This is often more 
effective than having the discussion leader 
attempt to tell them what to do. 

In these discussions, one frequently sees 
evidence of a carry-over of problems from 
the parent’s own childhood. There is also 
frequent expression of the extent to which 
a child is wanted or unwanted. Another 
normal concern is related to what should 
be or could be done if the child should be 
mentally or physically abnormal. One also 
encounters the fear of delivery. The 
father’s attitude regarding the arrival of 
the new child is often discussed as is the 
problem of preparing older.children for 
the coming of a new baby. 
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In one group in which the writer par- 
ticipated, this latter problem resulted in 
a rather lengthy discussion of sex educa- 
tion and methods of informing the older 
children about the coming of the new 
baby. Several mothers had expressed 
doubt as to how this could be done on a 
simple level. Cne mother said that she 
thought that one should try to tell children 
so they could understand. She said, “For 
my little folks about this high (about 30 
in.), I tells them I got that new baby in 
a warm spot right close to my heart; 
and he is gonna stay there and grow until 
he is big enough to come out in this world 
of sunshine; and then he will play with 
you.” Later she added, “I don’t say he’s 
just growing in my belly.” Such a warm 
feeling expressed by this mother did much 
to illustrate to the group how simply and 
well an explanation could be given to a 
young child. 

Another type of group situation which 
is usually provided by Public Health De- 
partments is the well-baby clinic or con- 
ference. The mothers who attend are ac- 
customed to preventive services in the 


physical field, and it is therefore relatively 
easy for them to see the value of discus- 
sions about normal growth and develop- 
ment. As might be expected, these mothers 
are only too eager to talk about the baby 


and the problems he presents. Through 
these discussions, they become aware that 
many of their problems are not unique, 
and in fact, occur quite regularly in a 
normal family life. The type of questions 
which arise can easily be imagined. Many 
questions relate to feeding problems- 

whether the child should be encouraged 
to continue breast-feeding, whether he 
should remain on a definite schedule. 
Habits of sleep, play and toilet-training 
are likewise discussed. Frequently, ref- 
erence is made to the problem of sibling 
rivalry, and the young mother is often 
reassured by an older mother who has 
several children. Usually, it is not in- 
formation which these people need or 
want, but rather an opportunity to express 
their feelings about what they consider 
their problems to be. The psychologist or 
the discussion leader must realize that he 
is dealing more with attitudes than with 
requests for knowledge and facts. The 
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personnel with whom the psychologist 
works in such a setting are a public health 
nurse and a clinic doctor who are usually 
very busy with the mechanics of clinic 
routine. However, they are interested in 
problems of a psychological nature which 
children present and in learning more 
about how parents can be helped with 
these problems. In this situation, as well 
as in those which follow, there will be 
problems and obstacles in working in 
group settings with members of other pro- 
fessions. One has to try to objectify one’s 
own feelings as well as those of the other 
workers. 

Private and public welfare agencies 
represent another community area in 
which the psychologist might work. 
People frequently come to these agencies 
in time of need, and their problems are 
often of a psychological nature. For ex- 
ample, these agencies often deal with the 
very young child in connection with adop- 
tion. Here the psychologist can apply his 
knowledge of early child development in 
attempting to evaluate the potentialities 
of the child and to work with the agency 
in finding the “right” adoptive parents 
for a child with a certain type of person- 
ality. The entire area of foster home 
care, including the child’s adjustment in 
the foster home situation, is one in which 
the social worker and the psychologist 
might work together. 

Another group situation in which young 
children are involved is the nursery school. 
Although communities vary greatly in re- 
gard to nursery school resources, fre- 
quently one finds considerable limitations 
in the training of staffs. However, these 
people are usually eager for any in-service 
training program and welcome assistance 
with many of the problems nursery school 
children present. By going to the school 
ratlier than having individual cases re- 
ferred to him, the psychologist has a bet- 
ter opportunity to observe the child in the 
group situation and to assist the teacher 
in understanding the particular behavior 
involved. He also has an excellent op- 
portunity to discuss with the parents the 
problems of children in the early stages 
of development. As might be expected, 
many of these problems result from anxi- 
eties on the part of parents over the first 
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separation or from home or marital diffi- 
culties. By participating in the actual 
school situation, it is frequently possible 
to help the teacher understand the dis- 
turbing factors. Again the psychologist 
is more frequently dealing with feelings 
and attitudes than with the need for spe- 
cific information relative to what action 
should be taken. Work with nursery 
school children provides an opportunity 
to deal with problems that might other- 
wise cause difficulty when the child enters 
public school. Hopefully, one may look 
forward to the time when public schools 
will be able to assume responsibility for 
the nursery age group. 

A fourth area in which the psycholo- 
gist can do community work is in the pub- 
lic or private school program. In fact, 
the work of the school psychologist is 
coming to be regarded as a field of its 
own. Although many school psycholo- 
gists perform services which may be re- 
garded as clinical in nature, there are 
many opportunities for work in the com- 
munity services area if the psychologist 
can visualize them. One of the most im- 


portant is the attempt to integrate the 
services of the school with those of the 
community in the field of health and wel- 


fare. The school psychologist, of all 
school personnel, is often in the best po- 
sition to assist in the coordination of these 
fields since, in working with the families 
of school children, he frequently works 
with the school social worker, or visiting 
teacher. He can also be in a position to 
assist in the integration of school services, 
particularly in the fields of health, special 
education, and guidance. Another area 
in the community field is in connection 
with parent-teacher groups. Many PTA 
organizations have pre-school study 
groups, and all of them are interested in 
knowing about ways in which the home 
and school can have a better working re- 
lationship. Within the school community 
itself, the psychologist has an opportunity 
to work with teachers around their own 
problems as well as to help them with 
their feelings about youngsters who pre- 
sent particular problems. If the school 
psychologist also works in vocational guid- 
ance and placement, contacts will be made 
with business and industries in the com- 
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munity relative to the placement of pupils 
who complete or discontinue school. 
There are other areas in which some 
clinical psychologists are working which 
have implications for a broader commu- 
nity program. Although many psycholo- 
gists in mental hygiene clinics or child 
guidance centers may be concerned largely 
with the diagnosis and treatment of clini- 
cal cases, there is an increasing trend 
toward broadening the program in terms 
of community education. The psycholo- 
gist working in the juvenile court setting 
also has an opportunity to help the com- 
munity become aware of some of the un- 
met needs of children. Perhaps the use 
of psychologists in connection with the 
juvenile department of the city police de- 
partment might reach these problems at 
an earlier stage. A greater use of group 
agencies in the community might also help 
children who show tendencies toward de- 
linquency. In some communities, psy- 
chologists work as vocational counselors 
in connection with an organized commun- 
ity agency program. Although the stated 
purposes may be for vocational counsel- 
ing, many personality problems and family 
situations present themselves. The psy- 
chologist may not treat these problems 
directly, but he has an excellent oppor- 
tunity to refer them to agencies where 
more intensive help can be given. The 
clinical psychologist functioning in an in- 
dustrial situation also has an important 
job in the broader community aspects of 
meni:’ health as his work encompasses 
the worker’s total living situation includ- 
ing his economic and social adjustment. 
In summary, it is felt that the psycholo- 
gist in the community services field must 
first evaluate his own conception of his 
functions and the possible contributions 
he may make. His training and experience 
have given him an understanding of basic 
needs of individuals and ways in which 
these needs may be met. Secondly, the 
psychologist needs to become more fami- 
liar with community resources including 
all types of agencies and organizations 
concerned with the health and welfare of 
people in all socio-economic levels. Only 
with a clear understanding of the func- 
tions of these agencies and the types of 
problems they encounter, can the psy- 
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chologist hope to be able to see how his 
particular specialty may be of value in 
meeting human needs. In addition, the 
psychologist must recognize the value of 
going to the working situation or setting 
of other workers instead of having cases 
brought to him. 
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Finally, the psychologist must come to 
know the methodology of allied fields and 
believe that by working with members of 
other professions new methods can be 
found which will help people live more 
normal and happier lives. 
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This report deals with an attempt to 
meet a practical need and to evaluate the 
effectiveness of the attempt. In the sum- 
mer of 1948, a request was made of the 
Psychology Department of Northwestern 
University to suggest a program in child 
guidance for the city of Sterling, Illinois 
—a city of about 12,500 people. The re- 
quest came from the Junior Chamber of 
Commerce. It seemed to the writer that 
this group of business men, with little or 
no preconceived notion of the nature of 
“child guidance” felt that a service of 
this nature for children in the community 
might be a worthy project for their spon- 
sorship (in competition with groups such 
as Lions and Rotary, which currently 
supported projects for blind and crippled 
children, etc.). However, it seemed also 
that the group had a hazy idea of concepts 
such as “child guidance,” “clinic,” “men- 
tal hygiene,” etc. 

Subsequent correspondence and confer- 
ence led to the following program: With 
Miss Beatrice Weiner,’ the author spent 
three days in Sterling in February, 1949. 
Mornings of these three days were de- 
voted to clinical interviews and examina- 
tions.” Afternoons were given to formal 
talks or informal seminar sessions with 
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the following groups: mothers of pre- 
school children, mothers of adolescents, 
grade school teachers, fathers, a combined 
teen-age and parent panel, and the com- 
bined PTA for the whole community. 

Prior to the actual project, groups in 
the community—the county medical so- 
ciety, businessmen’s groups other than the 
Junior Chamber of Commerce, the 
YMCA—were informed of the project 
by the sponsoring organization. In- 
terestingly, the only reservation in en- 
thusiasm at this stage came from the 
clergymen’s organization. However, the 
guidance counselor’ in the high school, a 
teacher who gave part time to this work, 
reserved her overt support until the first 
day of the program when she had oppor- 
tunity to discuss the project with the 
writer, As the program developed, this 
teacher turned out to be of most valuable 
assistance in the program as a whole. An 
additional assistant‘ worked on a volun- 
tary basis. The wife of a local physician, 
she was of considerable help in gathering 
case history material, and in implementing 
the mechanics of appointments, etc. 

The “clinic” was publicized in the local 
daily newspaper in front page stories on 
four occasions: a week prior to the proj- 
ect, and each of its first three days. The 
final story carried a picture of the teen- 
age parent panel. It might be considered, 
then, that the project was given relatively 
good publicity. 

Two months after the program was held 
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in February, a sampling of opinion was 
obtained through interviews of about 1 
per cent of the population. This investi- 
gation was conducted by David Murray, 
whose study is reported in a separate pub- 
lication. In order to disguise the real 
intent of this investigation, questions 
largely of an open-end type were used. 
Dealing initially with what the respondent 
might do if faced with a problem in a 
child, questions then became more specific, 
in terms of what sort of service might 
seem important in relation to problem 
behavior in children, how such service 
should be supported, etc. Finally, the 
questions touched specifically on what the 
respondent knew of the program that had 
been conducted two months previously. 

It is not the purpose of this report to 
present the details of this survey, but it 
was apparent that it yielded a double 
harvest. It was found that the program 
had reached a very small minority of the 
population, but also that there was an 
amazing dearth of real feeling for the 
concepts of child guidance or psychology 
or psychiatry, or the possibility of seek- 
ing help in relation to children’s problems. 

For example: in connection with prob- 
lems in children (such as antisocial be- 
havior, stealing, lying and excessive shy- 
ness) only three to four per cent of the 
population stated that they would seek 
outside help. However, in the case of 
failure in school, 50 per cent would seek 
such help. A very large proportion of 
the population would use physical: punish- 
ment, 60 per cent for antisocial behavior, 
40 per cent for stealing, and 40 per cent 
for lying. 

Of those whom one would consult for 
child problems, teachers were most popu- 
lar, with the physician in second place. 
But of institutions which are available, the 
church was in the lead. 

Murray found that “‘psychologists were 
favorably considered by a_ decidedly 
larger number of people than considered 
them unfavorably. However, they were 
considered less favorably in general than 
school officials, friends, and the 
YMCA; not to mention physicians, 
teachers, and the church.” 
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In regard to the effect of the clinical 
program itself, the following results were 
obtained : 

(“Did you hear or read anything about 
the child guidance program held here in 
Sterling this past February? If so, 
what ?”’) 

No, hadn't read or heard about it. 

Read about it, but don’t remember what. 

Heard about it, but don’t remember what. 

Attended one or more of the talks. 

Heard about it and gave opinions on the 
program. 


These figures indicate that despite 
widespread publicity, the particular type 
of program which was tried failed to 
register with many people. Impressions 
of the writer subjectively, and of those 
who were interviewed by Murray follow- 
ing the program, were that the public lec- 
ture aspect of the program was almost 
ineffectual in reaching any but a negligi- 
ble minority of the population. It was 
impossible to determine how the actual 
clinical service (extended to, at most, fif- 


teen families, on a confidential basis) 


might, if continued on a repeat-perform- 


ance basis, finally achieve reputation with 
a substantial portion of the citizenry. It 
may be repeated that, when asked specifi- 
cally, 70 per cent of the people in town 
felt the need of a permanent child guid- 
ance specialist or agency—to be supported 
preferably by town funds. 


SUMMARY 


In this project, a “clinic” was held, for 
three days, in the town of Sterling, Illi- 
nois. The program, which was given 
what is felt to be relatively good news- 
paper publicity, consisted of several pub- 
lic lectures and seminars and a confiden- 
tial psychological service to a few children 
and their parents. 

Investigation of public opinion of 1 per 
cent of the town two months later showed 
that, in terms of their recall for it, the 
program (1) had reached a very small 
proportion of the people and (2) more 
important, perhaps, for our general un- 
derstanding of mental health in the com- 
munity, the stated opinions of these adults 
regarding their practice in dealing with 
children who might offer problems reveals 
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a marked divergence from what is gen- 
erally considered hygienic and effective. 
Moreover, but a small proportion of the 
population would seek any help at all. 


REFERENCES 
Murray, Davin C. An investigation of one 
town’s opinion relative to the problems of 
child guidance. Child Development, 1949, 
20, 79-100. 





PSYCHOLOGICAL RESEARCH IN THE COMMUNITY MENTAL 
HEALTH SERVICE FIELD* 


ALVIN 


ZANDER 


University of Michigan 


The need is obvious for the develop- 
ment of public health practices which will 
control the causes of mental ill health as 
effectively as is now done with many 
other diseases. It is equally clear that 
developing truly preventive community 
mental hygiene practices will be compli- 
cated and difficult, because the usual in- 
hibitions to social action are confounded 
and multiplied by the threats created when 
emotions appear likely to become a sub- 
ject for public scrutiny. Here is a rich 
area for psychological research oppor- 
tunities. 

It is the purpose of this paper to dis- 
cuss the opportunities and the methodolo- 
gical problems for the psychologist doing 
research in the field of community men- 
tal hygiene. This discussion will be 
divided into three parts: 

1. A description of some likely areas for 
research and some examples of re- 
search problems. 

A brief listing of some criteria for 
choosing likely research emphases out 
of the wide range of possibilities. 

An example of a hypothetical research 
program, described in order to show 
the problems and challenges in re- 
search methodology which exist in 
studying a community problem. 


Research on community mental hy- 
giene, it seems to me, can best be attacked 
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by studying those factors in total com- 
munity life which prevent or promote the 
development of healthy patterns of ad- 
justment by individuals or groups. Stat- 
ing this a little differently, research in 
community mental hygiene might best be 
concerned with the nature and the origin 
of conflicts, frustrations, or corifusions 
for persons or groups which are part of 
the community way of life. It would also 
be concerned with those efforts in com- 
munity life which are attempting to re- 
lieve the unhealthy influence of conflicts, 
frustrations and confusions. This means 
that research in community mental hy- 
giene is work in an applied field which is 
intending to implement efforts in prevent- 
ing mental illness on the community level. 
In the light of this suggested direction 
it is possible to see four general areas of 
research. Let me mention the four of 
them and then give several illustrations 
of projects within each. The four are: 
1. Research which can be done on men- 
tal hygiene activities which now exist 
in the community and which can be 
recognized as such, either in whole or 
in part. 
Research which can be done on mental 
hygiene functions which do not now 
exist and for which there appears to 
be a need on the community level. 
Research intending to make more 
clear the nature and sources of cer- 
tain conflicts, frustrations, or confu- 
sions and of dynamics involved in ef- 
forts to remove these. 
Research on the major sources and 
channels for inducing certain patterns 
of adjustment on the part of individu- 
als in the community, 
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It may be helpful to cite several exam- 
ples of research projects in each of these 
general areas. 


AREA ONE: RESEARCH WuicH CAN BE 
DoNE On MENTAL HyGIENE Ac- 
TIVITIES WuicnH Now EXIstT IN 
THE COMMUNITY 


One of the major difficulties in com- 
munity mental hygiene lies in encourag- 
ing collaboration among those people in 
the community whose function directly 
aims at influencing the personality devel- 
opment of others. These include teach- 
ers, social workers, therapists, ministers, 
youth leaders, parents, and others. It is 
often true that people in these roles, in 
greater or less degree, misunderstand the 
abilities, responsibilities, and aims of one 
another and thus find it difficult to work 
together. It would be helpful, then, if we 
had data on hand which gave us some 
indication of the degree of mispercep- 
tions each of these roles has about the 
others in any specific community. A re- 


cent study by Jenkins and Lippitt“) con- 
cerning the misperceptions that parents, 


teachers, and students have of each other 
illustrates very well the nature of the dif- 
ficulty one meets in attempting to create 
collaboration on personality growth ef- 
forts among separate community roles. 
The next step in this direction, of course, 
would call for research on the most effec- 
tive methods of removing these misun- 
derstandings and setting the stage for col- 
laboration activities. 

Another related project is an attempt 
to determine the readiness which people 
with potential mental hygiene influence 
have for work in the community setting. 
Most of our thinking and training in men- 
tal hygiene is oriented toward the in- 
dividual person. It seems feasible to 
hunch that the training of most of these 
potential prevention sources would make 
them unable and unwilling to think in 
terms of community factors which in- 
fluence mental health. Such data would 
help us to predict the nature of the re- 
sistances we would meet as we attempt to 
change these persons into hygienists who 
are oriented toward working for 
munity health. 


com- 
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A final example of a research activity 
on things as they now are is research in 
various methods of mental health educa- 
tion. It seems very unlikely that pos- 
ters, newspaper stories, or radio talks will 
make much impact here. Study is needed 
on the best media for communication of 
such material but more important is the 
problem of the best conditions for receiv- 
ing such information and making it a 
part of oneself. The State University of 
Iowa, for example, found that Mothers’ 
Clubs who heard radio talks about child 
care as a group were much more influ- 
enced by the speaker than those who lis- 
tened to the talk at home alone. 


AREA Two: RESEARCH ON COMMUNITY 
MENTAL HyGrene Functions WHICH 
Do Nor Now Exist Burt For 
Wuicnh THERE AppEArs To 
Be A NEED 


Some of the most interesting research 
possibilities may be found in measuring 
the effect of introducing new practices in 
community mental hygiene. For exam- 
ple, many communities may be ready for 
the use of an at-the-elbow consultant for 
town administrative officials such as city 
councils, school boards, community coun- 
cils, or others. A precedent for this kind 
of service may be found in the morale 
officer who advised the line-officers dur- 
ing the war on the psychological mean- 
ing of certain group behavior®. The 
work of Adam Curle®), an English an- 
thropologist, in consulting with the offi- 
cials of a small town is another example 
of what we have in mind here. This sug- 
gests that there may be much to learn 
from instituting the role of the commun- 
ity group consultant who helps groups 
understand the nature of the tension re- 
leases they use as a group and the mean- 
ing that this may have for the health of 
individual members. The use of psychia- 
trists in consulting training groups at the 
National Training Laboratory in Group 
Development suggests that there is much 
value in a careful analysis of such a role 
among community groups®)?. 

There has been relatively little study 
of the effect of informal therapy groups, 
although the efforts of Bales“ in examin- 
ing the nature of Alcoholics Anonymous 
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indicates that groups which have no for- 
mal attachment to some institution can 
go far in helping people to understand 
themselves. A further study of the con- 
tributions of such informal therapy 
groups may be fruitful. 

The dynamics of preventive work in 
mental health would also be enlightened 
by a careful study of the influence and 
role of community mental health aids 
such as used by Greco at Aliquippa, 
Pennsylvania. Greco has enlisted the aid 
of a number of outstanding community 
citizens who can help his mildly-ill pa- 
tients to meet some of their needs in the 
community. One helper may provide 
channels to group membership, another 
to certain skills, and still others to what- 
ever may be seen as a way of meeting 
some of the citizen’s needs. 

A final suggestion on research studies 
of new mental hygiene activities is the 
heightening of community self-awareness 
among the town members so that their 
sense of town-belongingness is increased. 
It seems clear that communities with 
high transiency rates contribute much 


more than their share of mentally sick 


people. Although not all of the situa- 
tional factors contributing to ill health 
may be relieved by raising each individu- 
al’s sense of community belongingness, 
there is enough evidence from research 
in military, housing, and _ industrial 
morale to make this an area well worth 
further study. I would predict, for ex- 
ample, that a sufficiently heightened sense 
of community belongingness would lead 
to community problem-solving efforts 
which might go far toward relieving many 
of the conflicts, frustrations, and confu- 
sions present in a community, or to the 
development of community — standards 
which would better define the roles and 
relationships between these roles of com- 
munity members—leading to greater per- 
sonal security. 


AREA THREE: RESEARCH INTENDING TO 
Make More CLEAR THE NATURE AND 
Sources OF CERTAIN CONFLICTS, 
FRUSTRATIONS, OR CONFUSIONS IN 
THE COMMUNITY PATTERN 


Several examples are all that need to 
be mentioned here. It is interesting that 
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the well-developed methods for making 
morale surveys have been little used in 
the community. The experience of the 
bombing surveys®® 7) in Germany and 
Japan can serve as examples of the type 
of work which would be useful to any 
program in community mental hygiene. 
The study made by Curle and Trist“ in 
determining the adjustment problems 
shown by British soldiers after they had 
returned home from rehabilitation camps 
provides another example of the type of 
method which could be used in studying 
these problems. 


AREA Four: RESEARCH ON THE MAJOR 

SouRCES AND CHANNELS FOR INDUC- 
ING CERTAIN PATTERNS OF ADJUST- 
MENT WITHIN COMMUNITY LIFE 


The selection of this research area is 
based on the assumption that many of the 
behavior patterns which are interpreted 
as symptoms of illness are adopted by 
contagion from those with whom one as- 
sociates. It would be helpful, therefore, 
to know the contagion sources of these 
behavior patterns and the channels they 
follow through community groups. 

For example, there seems promise in 
assuming that groups as groups use pat- 
terns of tension release which are adopted 
by the group members for handling their 
own tensions and which may or may not 
be healthy for the individual members, or 
for the group in the social structure. The 
psychiatrists, Main and Nyswander, in a 
recent unpublished study®), report their 
perceptions that the usual group mechan- 
isms of decision reaching, blackboard list- 
ing, talking off-the-point, intellectualiz- 
ing, granting the floor to the strongest 
members, and many others have an im- 
portant tension-releasing function just as 
do the more familiar practices of scape- 
goating, or hostile jocularity. The fam- 
ily, club, and work situations, then, may 
all suggest to the individual member cer- 
tain patterns of adjustment useful to him. 
What these are and how they get com- 
municated and supported is the research 
problem. 

We have briefly glanced at a number 
of research possibilities in the general 
area of community mental hygiene. Ob- 
viously, there are many more problems 
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ready for attention from the psychologist 
in the community health service field. 
What criteria can one use for choosing a 
research emphasis out of the large array 
of possibilities? Let us look at a tenta- 
tive list of criteria for helping in such a 
choice-making situation. 


1. Since community mental hygiene is an 
applied field, it seems sound to assume 
that a major criterion is that the re- 
search be concerned with the engineer- 
ing problems of implementing efforts 
to prevent mental illness. 

The research will be most useful if it 
is concerned with ways of promoting 
mental health in groups or in the so- 
cial structure rather than with indi- 
viduals as individuals. 

It will be better to concentrate on re- 
search concerned with distributing the 
responsibility for mental health over a 
wide number of persons rather than 
limiting it to the responsibility of the 
therapists and social workers, since 
community mental hygiene must af- 
fect the way of life of all members in 
that town. 


It is best to start on problems which, 
when results are available, will show 
likelihood of influencing the largest 
number of people. 


ven after wise selection of the re- 
search emphasis, there will be many diffi- 
cult problems in the methodology of re- 
search in community mental hygiene. We 
can illustrate some of these by following 
through the hypothetical experience of a 
social psychologist as he develops a pro- 
gram of research. 

When the story begins the psychologist 
is sitting in his office waiting for the ap- 
pearance of a committee from a nearby 
town who have asked for research help. 
The town an industrial one with a 
population of about 18,000. It has a his- 
tory of attempts at fairly progressive pro- 
grams in delinquency prevention through 
parent education and a noticeable lack of 
success in community integration shown 
by rivalry between organizations and 
apathy in community efforts. 

As the professor muses about the com- 
mittee’s arrival he begins to speculate 
about the nature of the problems he will 


is 
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face. Ii he would soliloquize for 
us, we would hear him say: 


soon 


“T am worried about how representa- 
tive this committee will be. How will I 
get them to broaden their base of com- 
munity representation? I wonder, too, 
just what will be my best role. They are 
coming to me as an expert. How can I 
get them to use me wisely and yet not 
hinder their own creativeness and involve- 
ment? They certainly must see the find- 
ings as theirs if they are to be able to im- 
plement them. What will be the best 
place to start? And should we begin with 
a pilot study, a diagnostic investigation, 
some field experiments, or what ?” 


lis speculations are interrupted by the 
arrival of the committee. They are the 
editor, a school principal, and a family 
doctor. The discussion of this group 
leads to a later and larger meeting in the 
community made up ofa more represen- 
tative group. At the later meeting the 
decision is reached that the general prob- 
lem is the apathy for, and resentment to, 
local mental hygiene activities. For the 
sake of economy it is proposed that a 
pilot study is needed which can be car- 
ried out by locally trained townspeople. 
The psychologist also sees this as an ex- 
cellent means of widening the community 
involvement in this’ study. They deter- 
mine to get some facts: on the readiness 
and resistances of local public officials and 
influential people for mental hygiene ef- 
forts; on the stereotypes of human nature 
and personality held by a random sample 
of the population; and on the nature of 
the educational activities among adults 
now carried on in the community which 
are related to their goals. 

The psychologist pumps them for ideas 
and then prepares the interview schedules 
from the leads obtained from them. He 
trains the interviews and later develops 
the coding scheme. The data is gathered 
by the committee members and tallied one 
evening in the school gym at a tallying 
bee, with the help of training provided by 
the psychologist and some of his students. 

The rather gross findings of this pilot 
study show that many people are ready 
to act in community mental hygiene ef- 
orts, especially the professional persons 
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who influence personalities, but that they 
do not know what to do. It is also clear 
that many uncoordinated mental hygiene 
activities are going on in the community 
and that most of these reach the women 
who are parents. 

These and other findings are presented 
to a still larger group of people in the 
town. It is clear at this meeting that many 
of the key figures in town are against any 
attempts at mental hygiene efforts. They 
seem to think they are synonymous with 
“babying” people. They are able, how- 
ever, to arrive at two further areas of at- 
tack : 


1. A more careful diagnostic survey 

about what people in the town really 
believe and do about mental health. 
This is set up to be done by technically 
competent interviewers brought into 
the town. 
A field experiment is begun in train- 
ing certain key persons in the com- 
munity in problems of human rela- 
tions and how to deal with them. 
Measurements are developed for de- 
termining the effect of this program 
on the constituents influenced by these 
key persons. Since this is to be a 
demonstration project, very careful 
plans are laid for determining the 
means whereby this demonstration can 
be made most contagious to other com- 
parable groups in the community. 


In the meantime the psychologist has 
developed some crucial hypotheses of his 
own which can best be tested in the labora- 
tory where it will be possible to better 
isolate his major variables. He is able 
to induce graduate students to work with 
laboratory groups on the nature of group 
tension relieving mechanisms, and the 
communication of misperceptions among 
group members. 

When all these studies are completed, 
it becomes clear to the community that 
they are now ready for still further ex- 
perimentation, this time with attempts to 
get feelings communicated to key com- 
munity officials so that community actions 
consider feelings as well as facts. Thus, 
the psychologist finds himself ready to 
begin new field activities while looking 
toward the possibility of nailing down 


further crucial hypotheses in a laboratory 
setting at a later time. 

This brief look at the experiences of a 
researcher shows that the methodology of 
community mental hygiene studies has 
within it special problems of involvement, 
the choice of the proper level of fact-find- 
ing, the most effective role of the re- 
searcher, the use of certain criteria for 
choosing a place to begin, and many oth- 
ers. Few areas for research offer so 
many methodological challenges for the 
psychologist with a social conscience. 

The need is great for effective com- 
munity mental hygiene. The number of 
research possibilities within this general 
field is large. It is difficult to conceive of 
a research area offering more promise for 
opportunities to increase our knowledge 
of psychology and to work at the same 
time on important problems within our 
society. 
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I 


If psychology is to effect a substantial 
contribution to the field of community 
mental health services, it must take stock 
of what its productive functions are, can, 
or might be. It must also take stock of 
its trainees, its teaching staff, and its 
training programs with respect to effect- 
iveness in meeting these current and po- 
tential functions. It must ask itself 
whether its turned-out product should be 
persons with a well balanced set of skills, 
or specialists with outstanding but re- 
stricted skills, or if its potential functions 
are so broad as to require many different 
types of skills and personalities. It must 
ask itself whether its training programs 
are perhaps over-committed to certain 
functions and under-committed to others, 
which, in long time terms, might make 
more effective contributions. 

We shall begin this discussion by openly 
stating a bias in the following questions. 
Are we letting the obvious pressing needs 
of the mentally ill shape our training pro- 
grams too exclusively in the direction of 
giving students knowledge and skills for 
diagnosing and for trying to pick up the 
psychopathological pieces? And thereby 
are we failing to train personnel ade- 
quately to meet the less obvious and prob- 
ably more important needs of bending 
teaching, research, and clinical talents to 
the problems of prevention of mental ill 
health and to the problems of discovering 
and fostering the positive factors contrib- 
uting to personal and social maturity, 
integrity, and effectiveness ? 

This paper is asking many more ques- 
tions than it can answer or could answer 
with unlimited time, but it is hoped that 
they are questions upon which we will 

* Presented at the meetings of the American 
Psychological Association, Denver, Colorado, 
September 6, 1949, in the Division of Clinical 
and Abnormal Psychology’s Symposium on 
Psychology in the Field of Community Services. 


all ponder in the attempt to tease out leads 
to some of the answers. 

The inspection of functions can be ap- 
proached from many directions. Let us 
look at two. (1) The basic background 
and skills that psychology departments 
now give to students, which are of use to 
the field and which might be further ex- 
ploited and extended. (2) The problems 
in the mental health field which need solu- 
tion to which psychologists, as now 
trained or with modified training, could 
contribute. 

II 


The basic background and skills that 
training in psychology has to offer the 
field we shall briefly review under the 
headings of theory, research methods, 
basic knowledge, and specialized knowl- 
edge and skills. 


Theory. As for theory, our students are 
inundated with all kinds, implicit and ex- 
plicit, fragmentary and systematic, test- 
able or a credo to be believed, molecular, 
molar, mechanistic, purposive, field forces, 
dynamic, constitutional, psycho-biological, 
psycho-social, etc. From this overlapping 
hodge podge some students emerge in 
semantic confusion, some with doctrinaire 
inflexibility ; but the majority emerge with 
their own integration and are full of dis- 
ciplined theoretical drive. To colleagues 
from other disciplines, they may appear 
fuller of theoretical cliches than substance, 
but for most students, this theoretical 
training means sharpened concepts, more 
clean-cut research, and greater clinical 
productivity. The usefulness of this sub- 
mersion depends, of course, upon whether 
theory is competently taught so as to be 
regarded as a useful organizational tool 
productive of new research ideas or new 
clinical sensitivity, or whether it is an end 
in itself that produces aesthetic, albeit 
schizoid, satisfactions. 
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Research Training. The psychology stu- 
dent has perhaps more disciplined train- 
ing in regard to research design and 
methods than many collaborators in the 
mental health field. Therefore, he should 
perhaps be expected to make his larger 
contributions in research. This can be 
true, provided his research methods are 
for him again not an end but a means of 
organizing and discovering relationships 
among empirical data of theoretical rele- 
vance or practical importance to the field. 
If his training makes clear to him the ob- 
jectives of scientific method, not merely 
equips him with some of its techniques, 
he will be able to modify his techniques 
or invent new ones to handle the multi- 
factor, interacting variables with which 
research in this field must deal. He must 
have content knowledge of the field by 
first-hand contact with it if his research 
undertakings are to have relevance and 
substance. Certainly the need of relevant 
disciplined reality-oriented research in 
this bio-social-psychological frontier is 
acute. We have barely scratched the re- 
search surface with respect to the many 


facets of complex interrelationships, or 
even with respect to evaluation of many 
current research, diagnostic, and treat- 


ment procedures. We have practically 
not touched at all research upon preven- 
tion, or upon factors contributing posi- 
tively to mental health. We must see to 
it that we do not permit the pressing 
service needs to decoy permanently too 
much of our research talent either by our 
training emphases or by disproportionate 
rewards. 


Basic Psychological Knowledge. We all 
state that our students must have, in addi- 
tion to research and conceptual tools, a 
background of basic psychological knowl- 
edge before they specialize. All would 
agree that sets of facts and principles 
which have the widest generality should 
be an essential part of a student’s equip- 
ment. But much content is labeled 
“basic,” the speaker suspects, because of 
tradition and not because of its proven 
generality outside of simple organisms in 
simple controlled situations. There is a 
tendency to dichotomize between basic 
and applied in psychology after the anal- 
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ogy of physics and engineering, depend- 
ing upon the habitat of the investigator— 
if in the laboratory, ‘basic’; if in the 
field or clinic, “applied,” which, of course, 
is nonsense. We cannot accept that the 
“laws of learning’ derived from the 
media of nonsense syllables or from the 
elimination of errors by a rat in a maze 
have more than analogical generality to 
complex learning problems of human in- 
terpersonal relationships until research 
has established such generality. Many 
so-called “basic laws’ just do not lend 
themselves to application, and many re- 
lationships of wide generality have been 
discovered by research in applied fields. 

However, a broad sampling of the con- 
temporary body of established knowledge 
in the whole field of psychology through- 
out its specialized areas should give an 
informed base upon which to build in- 
vestigatory and service skills. But the 
student can be heiped immeasurably to 
secure a broad and coherent base in this 
era of specialization and expansion if the 
staff consciously and conscientiously pur- 
sues an active program of integration. 
The process can be helped through inte- 
grative courses by staff members of wide 
perspective, by various devices of in- 
service training—e.g., collaborative semi- 
nars, joint research projects, by a pro- 
gram which permits adequate time and 
opportunity for inter - communications 
among staff, and among staff and stu- 
dents, etc. Such programs can not only 
give the students a broader and more co- 
herent base but the faculty as well. 

From the applied areas our student ob- 
tains knowledge of more immediate rele- 
vancy, and attains skills with tools more 
immediately responsive to the problems 
of the mental health field. The contribu- 
tions of sampling and polling can aid in 
surveys of common problems in need of 
attack. The tools of testing, both objec- 
tive and projective, interview techniques. 
and group dynamic methods can have a 
fairly direct usefulness both in research 
and in the service aspects of diagnosis and 
treatment. Our danger here is that we 
may over-stress the immediately useful 
rather than follow leads that eventually 
might prove more productive. 

Another approach to inspecting appro- 
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priate or effective functions to which psy- 
chologists might contribute or be trained 
to contribute is that of the needs still un- 
met in the mental health service field. 
They are legion. Let us look at the train- 
ing opportunities of just a few of the 
established community agencies which in- 
evitably meet psychological problems both 
of a staff morale nature and among their 
clients, and thus are involved either im- 
plicitly or explicitly with mental health 
or its lack. 

1. Educational agencies from preschool 
through college present largely uninvesti- 
gated and unsolved problems of academic 
and social learning, of motivation, morale, 
status, aspiration strains, special problems 
of deficiency, and authority problems— 
inextricably mixed with problems of in- 
ter-personal relationships of teachers, ad- 
ministrators, school boards, and parents. 

Psychologists, of course, have partici- 
pated in schools with many problems but 
have failed, in the speaker’s opinion, to 
take advantage of its large arrays of nor- 
mal, happy, effective children for study- 
ing the factors which contribute posi- 
tively to mental health. Under the never- 
ending pressure of need for helping de- 
viants, we have spent too little time upon 
the healthy group from whom, in con- 
junction with our knowledge of deviants, 
we could learn what the real differentials 
are which make for maturity and zest or 
their lack. As psychologists, we have 
contributed little to the field of experi- 
mental education with respect to prepa- 
ration for parenthood and family living, 
mental hygiene, teacher morale, group dy- 
namics, and we have even failed to 
sharpen student awareness of and inter- 
est in the many unsolved problems which 
profitably could be attacked. 

2. Health agencies offer myriad possi- 
bilities for psychological functions. The 


prenatal clinics, obstetrical wards, and 


well-baby clinics offer a rich array of op- 


portunities for psychological investigation 
and service with respect to the surround- 
ing strains and supports in which the 
newborn begins his trek toward mental 
health or ill health. This is one of the 
high strategic age areas for effective at- 
tack upon the problems of prevention 
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which has been largely overlooked in the 
training programs. 

Agencies which handle dependents 
either through institutional or foster 
home care again offer rich opportunities 
for psychological services. The study of 
psychological atmosphere in institutions, 
of group dynamics, and of methods of 
management could shed light upon an 
area heavy with mental hygiene implica- 
tions. The field of foster home place- 
ment, with its meshing or failure to mesh 
the needs of both the child and the foster 
parents, offers a field which could be re- 
warding both with respect to research pos- 
sibilities and with respect to individual 
help. And yet very few training schools 
have adequately exploited these possibili- 
ties. 

With agencies frankly committed to 
mental hygiene functions such as counsel- 
ling centers, psychiatric,clinics, and hos- 
pitals, we see our possibilities more clear- 
ly and are contributing heavily, and our 
contributions will be greater, of course, 
as our expanding training programs im- 
prove. We are well aware, from the 
Mental Health Act provisions and from 
the Veterans Administration and_ state 
programs, of our responsibilities in con- 
tributing to the training of more well bal- 
anced, effective personnel needed to man 
the increasing numbers of such agencies. 
But all too frequently we have overlooked 
the psychologists’ opportunities for con- 
tributions to the community services pro- 
grams in agencies widespread in their im- 
plicit mental health functions. The speak- 
er feels strongly that we will never make 
a dent in reducing the number of people 
who need intensive expensive individual 
care unless we tackle the whole problem 
broadly, at the early ages, and with a 
strong preventive bias, which we must get 
into our training programs at both the 
service and research levels. 


IT] 


TRAINING FOR COMMUNITY 
HEALTH SERVICE 


MENTAL 


Let us inspect now three aspects of 
adequate training for present and poten- 
tial functions, namely, trainees, training 
staffs, and programs. 
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The selection of suitable trainees is an 
area in which we need to engage in both 
straight thinking and adequate research. 
Are the requirements the same for per- 
sonnel who will go into university teach- 
ing, into research, into activities which 
involve effective relationships with agency 
personnel, and into areas of work with 
disturbed persons? Can we, with real- 
ism, expect from candidates all of the 
requisites simultaneously for all of the 
divergent functions which are important 
to the broad field? 

We all know, among our former teach- 
ers and present colleagues, brilliant and 
productive research workers with little in- 
terest or talent in teaching. From their 
singlemindedness of purpose, their devo- 
tion to research ideas, and their compul- 
sive commitment to pushing research 
through, come important contributions. 
But you can imagine what they would do 
to themselves and to troubled patients if 
their compulsive and orderly personalities 
got mixed up in clinical service functions. 
All of us know talented and informed 
teachers who have made tremendous con- 
tributions to the field through their stimu- 
lating impact upon students, and yet have 
done minimal research. All of us know 
psychologists, mature and wise, whose 
libido and talents lie in personal relation- 
ships and service activities with persons 
and who contribute importantly to the 
field of training, and yet for whom hair- 
splitting abstractions and mathematical 
symbols are irrelevant or panic-producing. 

In our selection of students, can we find 
enough paragons capable of meeting all 
these functions, and could we survive 
them if we did? Rather, from our po- 
tential pool of talent must we not seek 
combinations of different selective criteria 
for different functions, if we are to avoid 
losing trainees of high potentials for 
many functions which probably demand 
different combinations of abilities and 
temperament ? 

In our present phase of selection, we 
are more clear as to negative aspects as 
shown in our elimination of those we 
judge without ability to meet our present 
academic hurdles, and with respect to 
those entering clinical specialization in 
our elimination of those too hostile, puni- 
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tive, narcissistic, compulsive, or power- 
driven. It is not just the applicants who 


have bearing upon. our selection criteria. 
These criteria must also be geared to the 
specific training staff with its unique ar- 
rays of talents and value systems. 


Training Staff. It is obvious that we 
need, as training staff, persons who satisfy 
the criteria we demand of our students. 
That is, we need a staff with a variety of 
talents, skills, and points of view, who 
likewise are not narcissistic, punitive, 
pewer-driven, or doctrinaire if they are to 
furnish an atmosphere evocative of stu- 
dent growth, independence, and integrity. 
We need teachers who derive genuine 
satisfaction from watching students ma- 
ture and achieve competences greater than 
their own. In short, we need a stimulat- 
ing, supportive, and mentally hygienic 
staff if we are to induce mature, zestful, 
and competent personnel in the mental 
health field. This is not an easy achieve- 
ment in a restive transitional period. 
With an increase of students, too size- 
able and too rapid for facilities and staff ; 
with the competitive demand for person- 
nel far greater than supply among uni- 
versities, research, and service centers; 
with the shifts of interest, emphases, 
prestige, and monetary rewards within 
the field; with training staff over-extend- 
ed and/or threatened by these shifts, it 
is a challenging period but one of strains 
and confusions. But if we teach within 
our competences, limit our students to 
the number we can handle adequately, 
seek to be mutually supporting, perhaps 
we can hang on until relief arrives. The 
relief which is on its way from our gradu- 
ate schools looks very good indeed, for 
by and large, the present group is more 
mature and experienced than the aver- 
age, better selected, and has had better 
training than their teachers have. And 
that is the compensation which far out- 
weighs the present strains or doubts. 


Training Programs. Time precludes dis- 
cussion of details of training programs 
for community mental health services. 
Only a few scattered comments can be 
made. 

As yet, with our variety of teaching 
personnel and budgets, standard programs 
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comparable to those of professional 
schools cannot now be achieved, and we 
may never find it desirable or possible. 
As departments, we must each survey 
our own talents, supplement them where 
we can, but stay within the training func- 
tions which are appropriate to these tal- 
ents. Better that we maintain substantial 
standards with fewer training objectives 
and fewer students than thinner standards 
with wider coverage. In the speaker’s 
opinion, it might have been wiser in the 
clinical field, until we had more experi- 
enced staff available, had experienced 
clinical teachers been concentrated in 
fewer centers so that each of these centers 
could have done a more effective job, in- 
stead of spreading them thinly over a 
large number of institutions. 

We must face, too, a reasonable de- 
cision with respect to service needs for 
persons trained below the doctorate. It 
is clear that there are useful activities to 
be performed in civil service positions al- 
ready established for whom there will 
never be enough doctorates. In state uni- 
versities charged with obligations for 


state welfare, we must face responsibility 
for training for these needed services, 


either directly or through seeing that 
training is adequately covered by other 
state educational organizations. 

We need periodically to review, as a 
staff, our courses to the end of reducing 
ineffective overlap, of checking the per- 
petration of vested-interest teaching hab- 
its and course content, and for increasing 
the relevance of methods courses to 
shifted field interests. We should re- 
view the experience we offer for research 
maturity, for acquiring teaching skills and 
skills relevant to a variety of special field 
problems. 

We should review the details of stu- 
dent load, morale, and the requirements 
for fostering the students’ greater talents. 
Especially in training in the clinical field 
do we need to be alert to timing and se- 
quences of experience which will facili- 
tate, not retard, maturity. For example, 
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students should not be dumped into adult 
psychopathology before having had pro- 
fessional experience with younger, more 
normal persons, or persons with milder 
problems. Students ‘in the clinical field 
need a wide array of experience, but so 
arranged as to insure their development 
and not the activation of anxiety past the 
point of profit. 

With the speaker’s early stated bias for 
greater sensitization of students to at- 
tacking the problems of preventive mental 
hygiene and to the study of effective per- 
sons, this training, coming early in the 
training sequence, could help in handling 
the matter of graded doses of maturing 
experience. 

CONCLUSION 


The present shift toward training more 
psychologists to investigate, to under- 
stand, and to give service to the field out- 
side the laboratory has raised and will 
continue to raise training problems. The 
approaches to solutions of the problems 
entailed in this shift with respect to op- 
timal balances of trainee interest, staff, 
and program details, will take time, ex- 
perimentation, and patience if training for 
productive functions is to be achieved 
according to priorities essential to main- 
taining these functions. If we build open- 
mindedly, teach what we can teach well, 
and try to extend our competences at a 
reasonable tempo, we are on safe ground. 
If we do not let ourselves be stampeded 
by a feeling of neurotic urgency, or fro- 
zen into neurotic resistance in the face 
of demands greater than we can now 
meet, we should maintain enough flexibil- 
ity and security to contribute substantially 
to our own discipline, and thereby to the 
mental health field. For in spite of 
strains, excesses, deficiencies, and con- 
fusion in our training programs, the field 
is full of enthusiastic, industrious, and 
productive graduate students, for whom 
we take some credit and from whom we 
expect help in improving training pro- 
grams. 








A SURVEY EVALUATION OF THE KINSEY REPORT 
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INTRODUCTION 


Not since 1859, when Darwin pub- 
lished The Origin of Species, has a pub- 
lication in the field of science caused so 
much discussion as has arisen from the 
publication of the Kinsey, Pomeroy, and 
Martin report, Sexual Behavior in the 
Human Male®), Comments of scholars 
and scientists concerning the significance 
of this report reveal a wide diversity of 
opinion. Evaluations range from enthu- 
siastic endorsements of the whole project 
to those which consider the entire re- 
search as worthless. Lack of agreement 
should serve.as a challenge for closer 
scrutiny of the whole project and as a 
stimulus for a more thorough evaluation 
of the significance of the research. 

One group of criticisms consists of 
those which more or less constitute a 
wholesale disapproval of the entire Kin- 
sey research project. In order to give the 
reader examples of such criticism, three 
are here reported. Dr. Harold W. Dodds, 
president of Princeton University, has 
stated, “So far as my reading has gone, 
the recent sex-survey reports seem to be 
acclaimed more by the literary reviewers 
than by the scientists. We laymen (yet 
speaking ex cathedra as President of 
Princeton University*) shall be wise if 
we pay serious attention to the scientists 
who question the methodology of the re- 
ports and the significance of their find- 
ings. Perhaps the undergraduate news- 
paper that likened the reports to the work 
of small boys writing dirty words on 
fences touched a more profound scientific 
truth than is revealed in the surfeit of 
rather trivial graphs with which the re- 
ports are loaded.” 

A similar criticism is made by Dr. 
Geoffrey Gorer, a cultural anthropologist, 
who states: “It is greatly to be regretted 
that a study on which so much time and 
money has already been spent, and which 
contemplates the spending of considerably 
greater amounts of both should be so in- 
adequate scientifically.” 


* Italicized words inserted by author. 


Dr. Margaret Mead, also an anthro- 
pologist, attacks the report as offering 
society “nothing to build with.” “The 
Kinsey report is not daring. It does not 
talk about emotion of sex, its meaning to 
people. We need to think more 
about sex as a part of inter-personal rela- 
tions.” She criticises Kinsey for handling 
the subject of sex “as an impersonal, 
meaningless act” and for perpetuating the 
Puritan attitude prevalent in this nation, 
and calls this attitude “extraor  narily de- 
structive of inter-psychic and _inter- 
personal relationships” 5), 

Such criticisms as given by Dodds, 
Gorer, and Mead not only constitute a 
professional challenge to the entire Kin- 
sey research staff, but also are directed 
against the scores of recognized scientists 
who have served as consultants te the 
research project and who therefore are 
in some degree responsible for its general 
structure and development.’ In a less di- 
rect way, these criticisms are also directed 
against the various institutions, agencies, 
and foundations which have formally 
recognized the whole project, and which 
have given in one way or another their 
active support to the study. One of these 
is Indiana University, which has recog- 
nized for the past ten years the Kinsey 
project, and which has allocated money, 
personnel, and space for its support. 
Also involved is the National Research 
Council, Committee for Research on 
Problems of Sex, which gave its formal 
endorsement of the study in 1942, and 
since then has assisted materially in its 
financial support, largely through funds 
granted by the Rockefeller Foundation. 
Therefore the validity of such wholesale 
disapprovals of the study raises a serious 
issue. 

The scholar should be equally cautious 
of blind and enthusiastic endorsements of 
an entire study or project. Usually sci- 
entists and scholars do not publish their 
approval or acceptance of research data. 
They merely incorporate into their work 
and studies the findings which appear 
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valid and useful to them. If they find a 
basis for significant criticisms, then they 
are more likely to announce their evalua- 
tions publicly. Such criticisms often con- 
tribute to the refinement and advance- 
ment of science. Instead of wholesale 
approval or disapproval these types of 
criticisms usually refer to such elements 
of the study as methodological procedures, 
inconsistencies in the published data, neg- 
lect of integral elements in the research 
design, limitations set by the sample or 
population involved, and. interpretations 
not warranted by the data. The right of 
free and open evaluations of research is 
necessary for the advancement of science. 
Certainly no scientific endeavor is be- 
yond criticism. Any scholar is entitled to 
render an evaluation of a study, but his 
status as a scholar depends upon the va- 
lidity of his evaluations. When an in- 
dividual incorporates his own biases or 
moral judgments in the evaluation of a 
research study, then the question must 
be raised as to the objective nature of 
such evaluations. 

An example of possible moralistic in- 
volvement in evaluation appears in Ter- 
man’s concluding statement in his review 
of the report: “Nevertheless, the passages 
quoted are just the ones that are most 
likely to impress youth who is in search 
of authoritative justification for the un- 
restrained satisfaction of his sexual 
a, This statement apparently is 

more upon moralistic concern 
rather than upon scientific evidence, since 
Terman offers no substantiating data for 
the claimed effect of the Kinsey data. The 
writer of this paper feels that systematic 
studies are needed which would establish 
the effects that this or any other book 
have upon behavioral patterns. The ef- 
fects ascribed to the Kinsey report by 
Terman must be regarded as speculative 
until adequate data support his viewpoint. 


urges’ 


based 


THe Stupy 


Since individual scholars such as 
Dodds, Mead and Gorer have individual- 
ly rendered a general disapproval of the 
entire Kinsey research project, it was felt 
that a more comprehensive evaluation of 
the over-all significance of the project 
might be of value. In order to obtain 
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such an evaluation, a questionnaire bal- 
lot was sent to all Fellows of the Division 
of Clinical and Abnormal Psychology of 
the American Psychological Association. 
The group numbered 330 Fellows accord- 
ing to the 1948 Directory, American 
Psychological Association™. Of the 330 
Fellows, 229 are men, and 101 are women. 
Nearly every Fellow of the Division of 
Clinical and Abnormal Psychology holds 
a doctor’s degree in psychology, and has 
had at least four years of experience in 
clinical and abnormal psychology. Thus 
it was felt that in general most of these 
individuals were qualified to render at 
least an over-all evaluation or opinion 
concerning the significance of the Kin- 
sey report. 

A ballot was sent by mail to each mem- 
ber during the summer months of 1948. 
The 295 who returned ballots constitute 
90 per cent of the possible number of 
respondents. The number of unreturned 
ballots from males was 8 per cent and 
from females 16 per cent. The return of 
90 per cent of all ballots is sufficiently 
complete to warrant fairly valid generali- 
zations for the entire population covered 
by this study. 

The specific question submitted to the 
group was: “Do you or do you not be- 
lieve that the Kinsey research project is 
sufficiently worthwhile to be continued to 
completion?”* 


Two response categories 
were provided on the ballot: “Yes” (1 do 


believe) and “No” (I do not believe). 
ach respondent was asked to indicate 
his evaluation by checking one of the two 
categories. Following the response cate- 
gories was the statement, “Comment if 
you wish,” and space was provided for 
the entry of any comments. The “Yes 
qualified” category was created for the 
six respondents who checked the “Yes” 
response and who then modified the cate- 
gory by adding a word or phrase. The 
classification of checked responses to this 
question is presented in Table 1. 

The evidence shown in Table 1 indi- 
cates that approximately 95 per cent 
(“*Yes” and “Yes Qualified” responses ) 
of the Fellows in the Division of Ab- 

* Dr. Leo Crespi assisted in the formulation 


of the questions in this survey and in the prepa- 
ration of the covering letter. 
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TABLE 1. 


OF KINSEY REPORT 


Responses to the question “Do you or do you not believe that the Kinsey 


research project is sufficiently worthwhile to be continued to completion?” (N = 295) 








Male 


Responses 


Female 


Total 


N % N % 





Yes (I do believe) 
Yes, qualified 

No (I do not believe) 
Comments only 

Not qualified to answer 


Totals 


87 273 93 
? 


“I 


we uty Ww 


| 


100 84 295 100 





normal and Clinical Psychology of the 
American Psychological Association con- 
siders the Kinsey research sufficiently 
worthwhile to be continued to completion. 
Analysis of these responses according to 
sex of the respondent reveals that 95 per 
cent of the males gave an approval for 
the continuation of the research and that 
87 per cent of the females gave a similar 


evaluation. Only 1 per cent of the males 
gave an over-all disapproval of the Kin- 
sey research project, while 6 per cent of 
the females disapproved. Thus 95 per 
cent of the psychologists included in this 
study have rendered an evaluation of the 
Kinsey report which is exactly opposite 
to that given by Dodds and others pre- 
viously mentioned. Only 2 per cent of 


Tasie’ 2. Classification of 156 comments 





Percentages 
(N = 156) 





I. Comments added after a “yes” or “ 
A. General approval 


yes qualified” response. 


1. Significant, worthwhile, needed study 


> 


Sub-total 


Value to psychologists, psychiatrists, etc. 


Yes, but opinion based on reviews, not original report ... 
Contributions far outweigh criticisms 
Emphasis made on the necessity of freedom of research in 


human sexual behavior 


‘riticisms of methodology 
General 

Sampling and statistical 
Interviewing techniques 


mMkbwrNALR 


wus 


Publicity criticised 


Sub-total 
G. Yes, but not an important study 


More emphasis on “psychological” aspects of sex 
Interpretations and generalizations 

Addition of specialists to the staff ... 

Staff should profit from criticisms 


‘omments on social implications of the data 


Q 


wwrriukthaos 


Il. Comments added after a “no” response. General disapproval 


of the study 


III. No response checked but comments given . 


Total .. 
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all the respondents were in essential 
agreement with President Dodds’ state- 
ment‘), 

The reader should not interpret the 95 
per cent (“Yes” and “Yes Qualified’) 
over-all approval figure as meaning that 
these respondents have given a complete 
approval of each and every aspect of the 
study. Undoubtedly most of these re- 
spondents could make some constructive 
criticism or suggestion for the refine- 
ment and improvement of this study. In 
fact, approximately 14 per cent of all re- 
spondents offered some specific criticism 
or comment after giving an endorsement 
for the continuation of the study. Some 
of these criticisms will be presented in a 
following section. 

There were 156 comments added by 
the 295 respondents under the heading 
“Comment if you wish.” Of these com- 
ments, 141 followed the 279 “Yes” or 
“Yes Qualified” responses; 6 followed 
the 7 ““No” responses ; and 9 were added 
when neither response category was 
checked (“No response” or “Not Quali- 
fied to Answer’). These comments were 
classified according to the nature of the 
comments or criticisms, and the results 
are presented in Table 2 

Representative comments placed into 
each of the classifications shown in Table 
2 will be given. In Section I of this table 
are listed various classes of comments 
which followed a “Yes” or “Yes Quali- 
fied” response. The percentages shown 
are based upon the 156 comments added 
by the respondents. Into the group which 
rendered a general approval of the report 
fell 39 per cent of the comments. These 
are placed in Section “I, A.” Examples 
of such comments are presented. 


1,A. General approval. 
Case 57. “It represents an attempt to gather 
data in a scientifically acceptable manner on a 
subject which has been surrounded by more 
fear, prejudice, and misinformation than almost 
any other subject. Accordingly it should be 
supported and encouraged to the utmost.” 

Case 176. “Definitely. The Kinsey report is 
unique in my experience in that it deals with 
sex as objectively as though it were a treatise 
on the internal combustion engine. I think it is 
important because we need to know as much as 
possible about human beings and_ this aspect 
has been too long neglected, at least so far as 
so called ‘normal’ persons are concerned.” 
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Cease 290. “This is the type of study which 
promotes growth toward maturity of the social 
group, since it reduces illusions and stimulates 
a realistic approach to an important problem.” 

Case 221. “It is sound scientifically, 
tive and most worth-while.” 

Case 259. 


obj eC- 


“About as important as any sci- 
entific study of man so far executed.” 

Case 122. “It would be 
ence and especially 
tinue Kinsey’s work.’ 

Case 198. “Enthusiastically. I know of no 
research that is more important for human wel- 
fare. Kinsey has done the best job so far on 
this topic. Kinsey has shown the highest ideals 
as a scientist and has clearly indicated the 
limitations of the study.” 


Case 168. “A monumental work. One of the 
most important studies of this century. 


Case 20. “No more important research in 
any field is, to the best of my knowledge, being 
conducted in the world today. Nothing should 
be allowed to interfere with its completion.” 

Case 88. “The work is invaluable in training 
clinical psychologists and psychiatrists.” 


I,B. Yes, but opinion based on reviews, 
not original report. 

Case 71. “I have not read the report, but 
have read reviews of competent scientists. 

In Section “I,C” of Table 2 are listed 
those comments given by respondents 
who consider that the contributions of the 
Kinsey data far outweigh published criti- 
cisms concerning it. The following quo- 
tations are examples of such comments. 


disastrous for sci- 
for psychology to discon- 


I,C. Contributions far 
cisms. 
Case 220. “Improvements in the techniques 
used might be suggested by some, but the in- 
adequacies mentioned by the critics ought not 


to detract from the positive values of the data 
already accumulated.” 


outweigh criti- 


In the next Section “I,D” of Table 2 
are classified those comments which em- 
phasize the scientist’s right to conduct 
research in the area of human sexual be- 
havior. The following statements are 
characteristic of the responses classified 
under this heading. 


ET. 


Emphasis made on the need for re- 
search in human sexual behavior. 
Case 45. 
contribution done by a group well- qualified as 


“T consider this study a fundamental 
scientists. If social science research is not to 
be made the butt of all jests—this study de- 
serves the opportunity to continue its fact find- 
ing procedures until the evidence gained satis- 
fies the basic requisite of a sound philosophy of 
sc ience. 
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Case 105. “There is certainly a tremendous 
amoutit of more accurate information than we 
ever had before. Any question of social sig- 
nificance on which at least some facts can sup- 
plant myths should be investigated. There is 
so much heat apparently about this book, that 
it should be emphasized that honest inquiry into 
anything is worthwhile. I cannot see that sci- 
ence or religion or politics has anything to fear 
from truth.” 

Case 239. “The Kinsey research project seeks 
to provide factual material in a field where 
traditions and opinions hold us in bondage. We 
need much more data and the continuation of 
the Kinsey research project promises to supply 
us with data, factual material and increased 
awareness in one of the most important aspects 
of human life and behavior.” 


In Section “I,E” of Table 2 there are 
placed those responses which consider 
certain social and moral implications of 
the Kinsey data. Two comments from 
this group are listed below. 


1,E. Comments on social implication of 
the data. 


Case 143. “Control aspects are directly in- 
volved in most serious desiring for knowledge 
of human sex behavior. Yet to reject, ignore, 
or evade this involvement is probably very 
smart and expedient in our culture. Hence this 
study seems low in critical acumen related to 
formulating the crucial problem and in social 
responsibility for developing interpretations of 
data for those who wish to escape or enforce 
some form or degree of control. The solution, 
in my opinion, is not to restrict but to extend 
and supplement the project, especially to in- 
clude direct acceptance of normative and evalu- 
ative problems, and, since controls will be di- 
rected towards producers of sex patterns—not 
their products—to problems of the structure of 
sex attitudes and sex personality types.” 

Case 118. “On the grounds that factual in- 
formation is always desirable. The big question 
will be what our culture does about it. I must 
reserve the right to say that ‘what is’ and ‘what 
ought’ are seldom the same. I seriously ques- 
tion the possibility of scientific ethics, which 
Cattell has recently defended.” 

In Section “I,F,” “Criticisms of meth- 
odology,” of Table 2 are placed those 
general and specific criticisms given by 
individuals who have indicated their ap- 
proval of the Kinsey research project and 
then offered a criticism or suggestion for 
future consideration. This group of 
criticisms constitutes 33 per cent of all 
comments. In such a tremendous and 
comprehensive scientific investigation as 
that being undertaken by the Kinsey staff, 
there is no doubt that specialists from 
many fields can contribute to the refine- 
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ment of such a study. The complexity 
of such an investigation of human behav- 
ior makes it necessary for the investiga- 
tors to rely heavily upon experts in areas 
involved in the investigation. Kinsey 
states in his first progress report that 
scores of. specialists from many areas 
have rendered invaluable assistance to the 
staff in the development of the research 
project. The comments given below by 
the group of psychologists surveyed range 
from very valid criticisms to those which 
reflect merely the emotional reactions of 
respondents. Criticisms of methodology 
are classified in Table 2 under 1,F, and 
examples follow. 


I,F 1. General criticisms. 
Case 253. “There is a tremendous amount of 
‘Information’ in this study but it lacks some- 
thing. It is my judgment that it lacks true 
sophistication in its methodological approach. 
It also lacks a cool perspective in its analysis 
and syntheses. To those of us who have tried 
to read the literature from the old masters, 
such as Havvlock Ellis on women, the study 
leaves us with a feeling that something is ab- 
sent that should be there. In spite of this I be- 
lieve the study should be continued but con- 
sideration given to pertinent criticisms.” 


In Section “I,F,2” are classified com- 
ments which refer to sampling and statis- 
tical aspects of the study. For example, 


I,F,2. Criticisms of sampling and statis- 
tics. 


Case 242. “I think that the criticism that 
medians should be used is valid.” 


Case 74. “It is desirable that all statistical 
controls and sampling problems be improved so 
as to eliminate spurious interpretations based on 
insufficient evidence or biased groupings.’ 

In Section “I,F,3” of Table 2 there 
have been classified all the criticisms re- 
ferring to interviewing techniques 
volved in the study. 


I,F,3. Criticism of 
niques. 

Case 132. “Believe direct question method 
often superficial but it is a first step in discover- 
ing factors in human sexuality. By all means 
the study should be completed.” 

In Section “I,F,4” of Table 2 there 
are grouped those statements which deal 
with the so-called psychological short- 
comings in the present report. The gen- 
eral opinion expressed in these comments 
is that more emphasis should be placed on 


in- 


interviewing —tech- 
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psychological and emotional aspects than 
have been included in the report. Exam- 
ples of such comments are listed. 


I,F,4.. More emphasis on 

aspects of ser 

Case 127. “There is no question in my think- 
ing regarding the value of the study. I feel 
that much more work of a psychological nature 
needs to be done but this taxonomic study will 
undoubtedly make such studies easier to ac- 
complish.” 


“psychological” 


In Section “I,F,5” of Table 2 are 
placed criticisms dealing with interpreta- 
tions and generalizations. An example of 
this type of criticism is given below. 


1,F 5. Criticisms 
generalizations. 


of interpretations and 


Case 133. “Both of* the 
are with the proviso that 
should more explicitly 
his generalizations so that 
accord with his data. The 
should be public.” 

In the next section of Table 2, “I,F,6” 
are placed all comments which suggest 
that in the future Kinsey should add cer- 
tain specialists to his research staff. 


lL FO. 


above (responses ) 
Kinsey, or 
restrict the scope of 
they are in closer 
data are facts and 


someone 
else, 


Addition of specialists to the staff. 
Case 142. “I 


that consul 
(psychoanalysis, psy- 
social work, anthropology, 
invited to with the 


think it desirable 
tants from other fields 
chiatry, psychology, 
education, etc.) be 
project e 


assist 


I,F,7” of Table 2 are clas- 
sified all statements which suggest that 
Kinsey should consider the criticisms 
which have emerged since the publication 
if his report and incorporate those which 
are valid. 


1,7. Staff should profit by criticisms. 


Case 188. “In the first place, I believe that 
the Kinsey Report is of sufficient importance 
that it should be carried on to completion more 
or less along the lines envisaged by Dr. Kinsey. 
He should report on his findings for women and 
then should continue his studies so that he has 
adequate sampling for both men and women. I 
am sure that Dr. Kinsey should take to heart 
the many criticisms that have been made of his 
sampling procedure and modify his plans to 
meet these criticisms. I believe that Dr. 
Kinsey should sensitive to criticisms of his 
method and, if necessary, modify his procedure 
so that there will be more general conviction 
that his results faithfully report the situation.” 


In Section “I,F,8” of Table 2 were 
placed all of the statements which con- 


In Section * 


also 
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stitute a criticism of the publicity which 
accompanied the release of the Kinsey 
Report. 

1,F,8. Publicity criticised. 

Case 162. “Might have been continued more 
objectively if there had been an attempt to 
avoid the type of publicity it has had and 
dramatization of total research—I would ques- 
tion effect of publicity on possibility of keeping 
method satisfactorily scientific.” 

In Section Il of Table 2 were classi- 
fied all the comments which were made 
after a “No” response to the question be- 
ing considered. These responses consti- 
tuted 4 per cent of all comments recorded. 
All individuals who made a “No” re- 
sponse added a comment. 


Il. General disapproval of the study. 


Case 38. “Decidedly no. It seems entirely 
too narrowly conceived. Kinsey is not a psy- 
chologist and I am not sure he is conscious of 
the full nature of his problem psychologically, 
a hi or ethically.” 

ase 174, “I regret to have to say that I do 
ia think the Kinsey type of study is very 
worthwhile continuing, and certainly not with 
a zoologist in charge of the project. There are 
anatomical, physiological, neurological, etc., ac- 
tivities involved, and these continue to be in- 
vestigated by competent people. There is also 
the cultural factor, and various anthropological 
considerations. The psychological, psycho- 
analytic, and abnormal aspects appear also to be 
important. Perhaps the most important as- 
pects are the cultural, moral, ethical, religious, 
economic, etc. This particular ‘drive’ is very 
different from all others, for many reasons; and 
such a study should be conducted by a much 
broader type of scholar, one who has an intel- 
lectual appreciation for other fields of knowl- 
edge. Kinsey’s procedures are faulty, and so 
are his statistics, etc.’ 

Case 171. “Because I think censorship is un 
wise and do not care to have more of such ma 
terial put into the hands of young people, 
would like to see the research project ended.” 

In Section IT] Table 2 were placed 
those comments given by individuals who 
did not check either of the offered re- 
sponse categories. Six per cent of all 
the responses fell into this classification. 
Most of the comments were statements 
to the effect that the individual had not 
read the report or did not want to make 
a decision in the matter. 

Table 3 presents an analysis of 
various classified responses according to 
the age of the respondent. The ages were 
obtained or estimated from the personal 


the 
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TABLE 3. 


OF KINSEY REPORT 


Age of respondents and nature of the responses given to the question, “Do 


you or do you not believe the Kinsey research project is sufficiently worthwhile 


to be continued to completion?” 


(N = 295) 








Age 
ranges 
(year 

of birth) 


Responses 


Yes U 
do believe ) 


Yes, 
qualified 


No (Ido 


not believe) 


Not 
qualified 


to answer 


Total 
no. of re- 
spondents 


Comment 
only 








1870-79 0 0 

1880-89 16 73% / 

1890-99 61 90 

1900-09 127 96 

1910-19 60 97 

Age not 
available y 


90 





100% 1 
14 22 
4 68 
132 


62 


10 





data given in the Directory 1948, Ameri- 
can Psychological Association. For ten 
of the number who returned the question- 
naires no data was given on which age 
could be estimated, and therefore their 
responses are classified under the heading 
“Age not available.” 

The data in Table 3 concerning age and 
nature of the responses reveal a fairly 
definite pattern. Of the respondents 
born after 1900, 97.4 per cent considered 
the Kinsey research project sufficiently 
worthwhile to approve its continuation to 
completion. Of those born before 1900, 
only &8& per cent of the respondents gave 
a “Yes” response to the survey question. 
Of the remaining 12 per cent in this lat- 
ter group, 4.3 per cent gave a “No” re- 
sponse, while 7.7 per cent did not respond 
to the question by either “Yes” or “No.” 
Most of this 7.7 per cent group stated 
that they were not qualified or did not 
care to render a judgment in the matter. 
\pparently the older respondents have 
greater difficulty in accepting or making 
an evaluation of the Kinsey study. The 
relationship between increase in age of 
the respondent and the failure to accept 
the research may result from the fact that 
the older generation was reared in a more 
Puritan age and is now in a less active 
period sexually. 

At the end of the questionnaire the fol- 
lowing statement was given, “If you are 
willing to be identified as holding your 
opinions, please sign below, otherwise 
your identity will be held in strictest con- 
fidence.” A space was provided for the 
respondent's signature. Of the 295 re- 


spondents 74 per cent indicated by add- 
ing their signature that they were willing 
to be identified publicly as holding their 
expressed viewpoint, and 26 per cent 
were not willing to be identified. When 
the responses were analyzed by sex of 
the respondent, three out of every four 
males were willing to be identified pub- 
licly as holding their expressed viewpoint, 
while two out of every three females were 
willing to be so identified. 


DISCUSSION 


Some of the comments and criticisms 
given by the respondents are not in ac- 
cord with fact either as presented in the 
Kinsey report or as available elsewhere. 
The purpose of this discussion is to point 
out such inconsistencies and in addition 
call attention to comments which appear 
to be very questionable. It is not the in- 
tent of the writer, however, to enter into 
a discussion of the more debatable criti- 
cisms given by the respondents. Such 
criticisms can best be considered by the 
Kinsey staff. 

The several criticisms regarding the 
publicity which accompanied the release 
of the Kinsey report indicate that some 
of the respondents were not aware of 
certain facts concerning its publication, 
as well as certain general practices of 
publishers. Obviously the author of a 
book selects his publisher. Kinsey re- 
leased his first progress report to W. B. 
Saunders & Company of Philadelphia, 
which is one of the oldest publishers of 
medical books in the United States. It is 
doubtful whether a more conservative or 
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reputable publisher could have been 
found. The publisher and not the au- 
thor determines the amount of money 
spent in promoting the sales of a book. 
The writer has never heard of a psychol- 
ogist who has written a book and then 
requested that it not be advertised. On 
the other hand, it is common knowledge 
that many psychologists have been disap- 
pointed with the sales promotion of their 
books and that they have encouraged their 
publishers to increase publicity expendi- 
tures. According to Kinsey's statement, 
no agreement was made with the pub- 
lisher concerning the amount of money 
to be spent in advertising the book. W. 
Bs. Saunders and Company has had com- 
plete control over the advertising. The 
publisher anticipated a first printing de- 
mand for the Kinsey report at 50,000 
copies and scheduled production based on 
this estimate. The subsequent demand 
for the book was explained by some re- 
spondents as resulting from an intensive 
publicity program. The publishing world 
knows that advertising alone cannot 
create such a demand for a book. 
Another criticism concerning publicity 
matters referred to the so-called “sensa- 
tional” nature of the advertising which 
W. B. Saunders used when the book was 
released. The writer has failed to locate 
any advertisement which contained more 
than a statement of the title of the book, 
the names of the authors, the names of 
some of the sponsoring organizations, 
the publisher and a very concise state- 
ment as to the nature of the report. If 
such advertisements constitute sensa- 
tional publicity, then practically all psy- 
chological and psychiatric publishing no- 
tices fall into this classification. Another 
comment stated that it became a_best- 
seller because of its “sensational” title. 
One needs only to glance over the titles 
of the tremendous number of psychologi- 
cal and psychiatric books to discover many 


other titles which appear to be equally 


‘sensational” in 
i Wi. 


Stekel’s 


nature. 
Henry's Sexual 
Bi-Sexual Love, 
berg and M. F. Farnham’s, Modern 
Woman, the Lost Sex. If sensational 
titles insured the number of sales of a 
book, certainly the ones such as quoted 


For example, 
Variants, W. 
and F. Lund- 
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above as well as hundreds of others 
should have equaled or exceeded the sales 
of the Kinsey report. 

Some of the comments referred to the 
limitations inherent in the population 
sampled in the Kinsey research. The 
data presented in the Kinsey report are 
based upon 5,300 white American males. 
In addition, the Kinsey staff had taken 
over 12,000 histories in all, and undoubt- 
edly their familiarity with their unpub- 
lished data enhanced the treatment and 
evaluation of the specific data drawn 
from the 5,300 samples. The criticism 
that the study was restricted in its value 
because of limitations in the size of the 
sample is, without doubt, valid. Kinsey 
is in utmost agreement with those who 
desire to see the sample enlarged so that 
greater confidence and wider interpreta- 
tions can be made from the data. 

Kinsey states in the report, “It is now 
estimated that 100,000 histories will be 
necessary to carry out such a project” 
3, Pp ©) However, with such limitations 
recognized, there is undoubtedly consid- 
erable value in publishing the results ob- 
tained from 5,300 cases. If a population 
of this size does not warrant publication, 
then practically all the research concern- 
ing human behavior which has previously 
been done would have to be disregarded. 
For instance, Terman’s volume on Sex 
and Personality was based upon only 94 
males and 99 females. 

A second group of criticisms concern- 
ing the size of the population includes 
those which suggest that the size of the 
population studied is entirely adequate 
and that in the future Kinsey should re- 
strict his work to more intensive studies 
of a few individuals. Some of the re- 
spondents who offered this criticism were 
interested in having Kinsey explore cer- 
tain theoretical constructs concerning 
psycho-sexual development which were 
not included in the experimental design 
of the Kinsey research. It is evident that 
each researcher must first determine the 
limits of his study, as it is obviously im- 
possible to study all things at once. Sci- 
entific method involves the fragmenta- 
tion of the universe and an intensive study 
of separate elements. The limits set on 
a study by any investigator may or may 
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not be most significant or wise, but sel- 
dom can contemporary researchers evalu- 
ate this aspect of research. Those who 
feel that Kinsey has omitted crucial areas 
in his investigations of human sexual be- 
havior should find it a challenge to pursue 
their hunches. It is apparent that the in- 
vestigation of human sexual behavior is 
of such a complex order that it cannot be 
completely or adequately investigated by 
any one researcher or any one research 
staff. The study of human sexuality is a 
scientific problem and is the province of 
all scientists who can and care to investi- 
gate it. 

Another set of comments concern the 
statistical treatment of the Kinsey data. 
Some of these will undoubtedly contribute 
to a refinement of the study, while cer- 
tain ones show the respondent’s lack of 
orientation to the statistical procedures 
involved in the Kinsey study, or their 
naiveté in statistical matters. Several in- 
dividuals have criticized the Kinsey re- 
port for using means instead of medians 
in the treatment of his data. This un- 


justified criticism has been popularized 


and accepted uncritically. An investiga- 
tion of the statistical tables in the Kinsey 
report reveals that both the median and 
the mean are given practically every time 
it was logical to calculate both statistics. 
The mean was used exclusively in cer- 
tain cases where the very nature of the 
data excluded the application of the me- 
dian. For example, the median was not 
used when more than half of the popula- 
tion is in a zero class. Moreover, it was 
impossible to make a comparison of sev- 
eral groups by way of medians if the 
median for any single group is flat zero. 
Frequently in Kinsey’s discussion of the 
data, he did employ the mean instead of 
the median. The use of the mean as the 
statistic for interpreting central tendency 
is a common practice in contemporary sci- 
entific reporting, and is probably the best 
understood of such measures. 

The comment was made that Kinsey’s 
data would have a deleterious effect upon 
youth. This assumption poses a very 
important research problem, and evidence 
bearing upon such a statement is certainly 
needed. In the meanwhile, psychologists 
should not accept such an assumption un- 
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critically. Specific evidence regarding the 
opinion should be sought. The writer 
believes that the publication of fact can 
only have beneficial effects upon society, 
although the re-evaluation or re-organiza- 
tion of values and patterns of behavior 
which such facts demand may not be ac- 
complished without some pain and strug- 
gle. 

Some criticize Kinsey for not explor- 
ing certain concepts inherent in certain 
theories of psycho-sexuality. Kinsey 
clearly describes the purpose of his study 
as being a fact-finding survey of what 
people do sexually. He did not set out 
to investigate any specific theories of hu- 
man sexuality. Scientifically # seems 
perfectly justified to determine the 
“what” before investigating the “how” in 
this particular problem. The data ac- 
cumulated by the Kinsey research staff 
should do much to clarify many of the 
theoretical explanations of human sexual 
behavior which have been accumulating 
during the past 2,000 years. Those who 
feel Kinsey’s approach has disregarded 
certain promising theoretical leads cer- 
tainly have the privilege of following 
their own investigatory hunches. 

Among the comments Were a_ few 
which criticized Kinsey for not utilizing 
specialists in other fields than biology. 
Kinsey points out in his book that hun- 
dreds of specialists of all types have been 
consulted during the ten years which the 
study has been under way. Many na- 
tionally known scholars have actually 
spent days in the Kinsey laboratory at In- 
diana University. These consultants have 
studied the data intensively, contributed 
to the experimental design of the study, 
suggested modifications of procedures, in- 
vestigated the statistical problems in- 
volved and added in numerous other ways 
to the refinement of the study. Actually 
thousands of hours have been spent by the 
Kinsey staff with specialists representing 
many areas of knowledge. Kinsey re- 
ports in his book that consultants were 
drawn from at least 33 contingent areas. 

The criticism was made that Kinsey, 
being a zoologist, was therefore not 
qualified to conduct a study which in- 
volved the handling of psychological ma- 
terials. If such a criticism were valid, 
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then psychologists would have to exclude 
the work of such scientists as 1. P. Pav- 
lov, Sigmund Freud, Havelock Ellis and 
numerous others, since they were not 
psychologists. The basic question in- 
volved here is whether or not the investi- 
gator is qualified to do the research. In 
a study of human sexual behavior, it is 
apparent that a large segment of the study 
would involve biological determinants. 
Kinsey's position as one of the foremost 
zoologists in the United States should 
certainly qualify him for this aspect of 
the investigation. Dr. Kinsey’s specitic 
qualifications in the field of psychology 
first consist of an undergraduate major 
in psychology. This reveals his long 
standing interest in behavioral problems. 
Secondly, his ten years of experience in 
the investigation of human sexual behav- 
ior should have contributed immensely to 
his ability for handling psychological 
data. There are few, if any, psycholo- 
gists who during the last ten years have 
had more intensive and extensive experi- 
ence in handling human behavioral mate- 
rials than that which has been acquired 
by Dr. Kinsey. Some individuals criti- 
cized the study because psychologically 
trained consultants had not been added to 
the staff. Such criticisms are contrary to 
fact, as Dr. Vincent Nowlis has served on 
the Kinsey research staff for over four 
years. Also Mr. Wardell Pomeroy, who 
has served on the staff for over six years, 
holds an M.A. degree in psychology and 
had acquired several years of clinical 
experience before he joined the Kinsey 
staff. Dr. Kinsey is actively seeking spe- 
cialists from several fields including psy- 
chology in order to increase the range of 
the professional talent on the staff. Only 
as additional research funds have become 
available, has such an expansion been pos- 
sible. Dr. Paul Gebhard, who received 
his training as an anthropologist under 
Kluckhohn and Hooten, was added to the 
staff over two years ago. Other special- 
ists will be added to the staff as the study 
progresses. 

A few criticisms were to the effect that 
the Kinsey interpretations were not in 
accord with his published data. In all 
such comments not a single specific ex- 
ample was cited, and therefore no evalua- 
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tion can be made or is demanded of such 
generalized criticisms. 


SUM MARY 


In order to obtain an over-all evalua- 
tion of the Kinsey research project from 
a group of qualified psychologists, a 
mailed questionnaire was sent to every 
Fellow member of the Division of Clini- 
cal and Abnormal Psychology of the 
American Psychological Association. The 
question presented on the ballot was, 
“Do you or do you not believe that the 
Kinsey research project is sufficiently 
worthwhile to be continued to comple- 
tion’” The response categories “Yes” 
and “No” were provided. This was fol- 
lowed by the statement, “Comment if you 
wish.” Of the 330 questionnaires sent, 
295 or 90 per cent of them were re- 
turned. Eight per cent of the males and 
16 per cent of the females failed to re- 
turn ballots. 

1. Approximately 95 per cent of all 

psychologists surveyed in this study 
considered the Kinsey research proj- 
ect sufficiently worthwhile to be con- 
tinued to completion. Only 2 per 
cent of all those surveyed indicated 
their over-all disapproval of the re- 
search. 
There were 97 per cent of the male 
respondents and 87 per cent of the 
females who approved the research 
in the manner described. 


When the responses were analyzed 
according to age of the respondent, 
it was found that 97.4 per cent of all 
those born since 1900 gave a “Yes” 
response to the survey question. Of 
those born before 1900, only 88 per 


cent answered “Yes.” Of the re- 
maining 12 per cent in this group, 
4.3 per cent gave a “No” response, 
and 7.7 per cent declined to answer 
the question. 

The respondents were asked if they 
were willing to be identified publicly 
as holding the evaluation and opin- 
ion which they expressed in their 
returned questionnaire. © Approxi- 
mately 76 per cent. of the males in- 
dicated that they were willing to 
have their responses made public, 
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while only 66 per cent of the females 
agreed. 


There were 156 of the 295 respondents 
(52 per cent) who gave an additional 
response under the heading, “Comment 
if you wish.” Responses so obtained 
were classified, and representative exam- 
ples of each classification were quoted. 
rhe writer discussed some of the points 
raised by their comments which appeared 
to be contrary to fact or based upon a 
lack of understanding of the Kinsey re- 
search project. 
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In speaking of the teaching of clinical 
psychology, | shall not present any ex- 
perimental findings for your edification. 
My own experimentation has never been 
concerned with problems of teaching, and 
[ hold the strong personal opinion that 
most of the experimental work in_ the 
field, while far from sterile, concerns it- 
self primarily with questions of methodol- 
ogy to the exclusion of more basic philo- 
sophical questions of content and educa- 
tional goals which are in need of consid- 
eration before we can effectively apply 
the results of any experimental investi- 
gation of methods of classroom communi- 
cation. Recently, I have seen the data 
of one experimental investigation of a 
teacher training program which seemed 
to have accomplished excellent results 
with one exception—the trainees failed 
signally in stimulating their pupils to in- 
dependent thinking. While many of my 
authoritarian colleagues will not be 
alarmed by this, many others, including 
myself (and we are solidly supported by 

* Address of the retiring president, Division 
on the Teaching of Psychology, American Psy- 
chological Association, Denver, Colorado, Sep- 
tember 9, 1949. 


the findings 


of non-directive therapy), 
will find this a serious delinquency. Many 
problems of basic educational philosophy 
remain to be at least partially explored 
before we can too confidently trust our- 
selves to the use of any method of class- 
room communication, however sound its 


experimental validation. Among these 
are the relative value of a broad, histori- 
cally oriented, eclectic point of view in 
classroom presentation versus a narrow 
one-system, intellectually provincial pres- 
entation; as well as the relative value of 
the culturally oriented, liberal arts ap- 
proach in education as opposed to the 
narrower, pre-vocational orientation of 
many of our present day curricula. 

The remarks to follow will concern 
themselves with a discussion of content 
in the teaching of clinical psychology, and 
will be limited to one type of content— 
namely, the dynamics of human person- 
ality. Clinical psychology as a profession 
is based squarely upon the facts of per- 
sonality dynamics and has long taken 
pride in its leadership and in the breadth 
and depth of its contributions, both ex- 
perimental and theoretical, in this field. 
Yet many of us in clinical psychology to- 
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day feel that our training programs need 
more of this approach, that our students 
need more training in the fundamental 
dynamics of normal personality the basic 
understanding of which underlies all the 
specific methodological practices, diag- 
nostic and therapeutic, of our profession. 

How can we supply this need? Any 
teacher would be false to the vested in- 
terests of the profession did he not men- 
tion the possibility of “adding more 
courses,” but my own solution would be 
to add more personality dynamics to our 
present courses. In our formal class- 
room presentation of psychological find- 
ings, as well as in our personal thinking 
about them, we should add to our con- 
sideration of the factual and theoretical 
context in which we usually present psy- 
chology some consideration of the per- 
sonal needs, strivings, and developmental 
history of the psychologists involved as 
well as the broader cultural trends re- 
flected in these psychologists’ needs and 
strivings. Our knowledge of the dy- 


namics of human personality offers, just 
as Logic does, an interpretive framework 


against which to evaluate the materials 
of psychology, since such materials, ex- 
perimental or theoretical, are the pro- 
ductions of very human, individual psy- 
chologists, and cannot help but be shaped, 
in greater or lesser degree, by the matrix 
of that personality of which they are a 
function. In -essence, I am suggesting 
that our psychological thinking (or our 
psychological behavior) be subjected to 
the clinical insight of the diagnostic in- 
terview, that we practice our clinical pro- 
fession with psychology as the patient. 
Parenthetically, this reaffirms my _per- 
sonal prejudice that diagnosis must pre- 
cede therapy. The promulgation of a 
psychological theory, or even the choice 
of an experimental design, has its ulti- 
mate roots just as firmly anchored in the 
dynamics of a particular individual as 
does a bit of compulsive behavior or a 
pathological obsession. There may be a 
difference in the amount of socialization 
exhibited by these widely separated be- 
haviors but they all spring from a basic 
matrix of human needs and desires. 

The application of our clinical knowl- 
edge to the interpretation of human be- 
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havior is nothing new, it is our very stock 
in trade, but so far we have been re- 
markably persistent in applying it to the 
man in the street, the patient in the office, 
the physicist in the laboratory, and the 
philosopher in print. We have been re- 
markably successful, nevertheless, in 
avoiding its application to ourselves as 
psychologists in psychology. To misuse 
a phrase of Max Meyer’s, we treat clini- 
cal psychology as “the psychology of the 
other one.” As a case in point, I recently 
read an able treatment of the projective 
movement in which the author stated 
that projective testing must be under- 
stood as a movement of protest. But it 
developed that in this case at least a 
“movement of protest” was to be under- 
stood entirely in terms of the inadequacies 
of the opposition. There was no men- 
tion of such factors as the insecurity, 
frustration, aggression, afd defensive 
overcompensation which usually accom- 
pany a protest movement. Let me hasten 
to add that the entrenched opposition 
must also be understood not only in terms 
of its logical and practical deficiencies 
but also in terms of the social dynamics 
of institutional perseveration. 

Where such a “clinical” treatment does 
creep into our consideration of psychol- 
ogy (as in Cureton’s recent discussion of 
“The Principal Compulsions of Factor- 
analysts”), it is usually developed hu- 
morously. 1 would suggest that it may 
be a more deadly business than we dare 
realize, and that we might well dispense 
with the defensive mechanism of humor. 
An outstanding exception to this general 
neglect of the motivational factor in psy- 
chology is Reik’s recent “Listening with 
the Third Ear” which contains many in- 
cidental instances of Freud’s understand- 
ing of his own motivations and a remark- 
able amount of candid self-revelation by 
Reik himself. My general thesis is stated 
in his words, “Psychology does not begin 
as self-observation. It ends there.’ 

The distortion of reason by emotion 
has long been recognized, and has led the 
logicians to a distinction between cogni- 
tive and emotive communications. When 
in the course of their famous “Battle of 

Sehaviorism” the late Professor Mc- 
Dougall refers to the stalwart Dr. Wat- 
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son as the antichrist and Dr. Watson 
answers tauntingly that Professor Mc- 
Dougall is returning to religion, it is ob- 
vious that more is involved than a mere 
rational consideration of the implications 
of their respective scientific productions. 
They are “mad” at each other. Personal, 
ego-involved “beliefs” are at stake and 
the resulting “argument” is not to be 
understood completely in terms of the 
logical consideration of certain scientific 
facts, but must be interpreted in terms of 
the personality structures of two posi- 
tive individuals. For a complete under- 
standing of this controversy we need a 
developmental history of both the organ- 
isms involved. 

I have never found a colleague or stu- 
dent who failed to recognize this, yet no- 
where in the literature can I find an ade- 
quate treatment of either behaviorism or 
hormic psychology from the standpoint 
of the personalities of the two men who 
so obviously influenced the development 
of these “schools.” As psychologists we 
are committed to the basic principle that 
personality influences behavior, but in 


practice we grant our colleagues the pro- 
fessional courtesy of not applying this 
principle within the psychological family 
itself. We grant them a “presumption of 


depersonalization,” a depersonalization 
which often is as unreal as the clinical 
depersonalizations we are called upon to 
handle in our patients. In overlooking the 
influence of personality on science, our 
attitude is strongly reminiscent of the 
Victorian attitude of American psychia- 
try during the first quarter of this cen- 
tury to the “unpleasant” realities of psy- 
chosexual development. Yet the behavi- 
oral phenomena exist, and cannot be re- 
moved by the comfortable mechanisms of 
repression. 

The phenomena of obviously emotive 
communications, however, constitute only 
a small part of the logical distortions that 
creep into our scientific thinking as a 
function of our personal dynamics. More 
interesting are the subtle distortions of 
cognitive thinking that are produced by 
motivational forces intruding from out- 
side the logical framework of scientific 
facts available for consideration in the 
solution of any problem. I am assum- 
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ing that science is relative, that it deals 
with the evaluation of probabilities rather 
than the discovery of absolutes, and that 
the scientist must always build his the- 
oretical structures upon the shifting sands 
of ever increasing experimental findings. 
At any moment we may act after calculat- 
ing our probabilities, but we must act 
with the clear recognition that our act is 
a gamble. As Reichenbach says, “We 
posit the event to which the highest prob- 
ability belongs as that event which will 
happen. We do not thereby say that we 
are convinced of its happening, that the 
proposition about its happening is true; 
we only decide to deal with it as a true 
proposition.” 

While this relativism is all that we have 
as scientists, it seems not enough for us 
as human beings. Committed to the rela- 
tive, we seek the absolute. Committed to 
partial knowledge, we strive for omnis- 
cience. Committed to an experimental 
basis for our science, we struggle to close 
by rational interpretation the gaps left 
open by our meager experimental find- 
ings. It is one aspect of that universal 
human phenomenon that my friend, T. H. 
Howells, has so aptly labeled the “hunger 
for wholiness.” Our relatives, the phi- 
losophers, are outgrowing this lust after 
cosmology, but psychology is still smitten 
with the absolute. It is just here, where 
we transcend our experimental findings, 
that motivation is particularly apt to in- 
trude to color and distort our thinking. 
Our experimental findings are the reality 
factors, the external world of objectivity, 
under whose control our intellectual de- 
velopment must proceed ; when we go be- 
yond them the pleasure principle rears 
its ugly head, and the path is open for a 
regression into the tempting world of 
autistic phantasy. 

One of the most apt characterizations 
of this tendency that I have ever heard 
was given by Professor E. G. Boring 
while lecturing on McDougall in one of 
his classes. Boring was discussing his 
early association with McDougall at 
Harvard and their frequent attempts to 
resolve their differences of opinion. Bor- 
ing mentioned the area of uncertainty or 
area of unpredictability that always re- 
mains even after the nicest of experi- 
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ments. Boring said that he suddenly real- 
ized that the root of his differences with 
McDougall lay in this area of uncertainty : 
“T called it probable error. McDougall 
called it God.” In essence it is the same 
error later committed by Eddington and 
Jeans when they derived deity from 
Heisenberg’s principle of uncertainty. 
It is the old familiar fallacy that what 
cannot be proven untrue is therefore true. 
because we wish it so. 

When we as theoretical thinkers tran- 
scend the experimental findings of our 
laboratories, there is much in our think- 
ing processes that bears analogy with the 
delusional thinking of the psychotic. As 
clinicians we are all familiar with the de- 
veloping psychotic process that strives to 
assert its claims while the patient strug- 
gles to still maintain himself within the 
framework of reality. The reality princi- 
ple still governs the developing autistic 
trends that seek constantly to find some 
weak link in the chain that binds the per- 
sonality to the stern demands of reality. 
Then finally the weak link is found, per- 
haps in spiritualism, perhaps in religion, 
perhaps in some garbled press statement 
of scientific findings ; and the harried per- 
sonality finally breaks loose from reality 
and departs upon its pleasant regressive 
journey. 

As_ psychologists we constantly face 
this never-ending struggle between the 
sternly limiting experimental findings of 
our science and the fierce drive of our 
personal needs and motivations. Too 
often the psychologist, like the schizo- 
phrenic, finds in some “area of uncer- 
tainty” or in the misinterpretation of 
some experimental finding the final ex- 
cuse for turning away from the grim 
confines of scientific reality to the pleas- 
ant fields of autistic affirmation. It would 
be unrealistic of us as scientists to hope 
that such a state of affairs can ever be 
completely avoided. The human organ- 
ism must be accepted as it is. But we can 
be aware of such motivational distortions, 
and can use our understanding in evaluat- 
ing them. It is here, in applying our 
knowledge of motivational forces to the 
understanding of psychology itself, that 
clinical psychology can make a great con- 


tribution in the classroom. We must ex- 
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amine our own motives and their influence 
upon our psychological behavior. We 
must ask our classical colleagues “Why 
a rat man?” and then turn to ourselves 
and ask “Why a clinician?” The answer 
will always involve our developmental his- 
tory as emotional organisms. Someday 
a new Freud may write a new “Future 
of an Illusion,” dealing with psychologi- 
cal theory as a defensive mechanism 
against insecurity and the demands of the 
cold, hostile world of nature. Today we 
can only point to the problem. 

Lest it appear that I am denying the 
place of theory in science, let me hasten 
to distinguish between what I may call 
the “open” system which follows closely 
the scientific rules of the game in achiev- 
ing a tentative organization of experi- 
mental findings, fertilizes the production 
of new findings, and eagerly adapts it- 
self to such new findings ; and the “closed” 
system, or System with a capital “S,” 
which atterapts a final and ultimate or- 
ganization, directs its experimental efforts 
toward only such findings as will reaf- 
firm the system, and bitterly resists any 
Let me also point 
out that in a world which contains a 
definable black and a definable white 
there exist as well an infinite number of 
greys. 

What I am saying is that science is a 
means of achieving relative knowledge, 
but that human motivation continually 
misuses it for the production of absolutes. 
lf the twentieth century will be marked 
in history by any single contribution, | 
feel that it will not be atomic fission, but 
rather Einstein’s development of the 
principle of relativity and our generali- 
zation of this into a basic code of scien- 
tific thinking.- Twentieth century man 
will emerge as relative man and his char- 
acteristic neurosis, anxiety, will be seen 
to depend in large part upon the necessity 
of abandoning his reliance upon a system 
of fixed and unchanging beliefs in order 
that he may live adaptively in a rapidly 
changing world. Where nineteenth cen- 
tury man awoke and faced each day se- 
cure in the possession of a series of fixed 
principles which would guide his actions 
throughout that day, twentieth century 
man awakes to no such comfort. Each 


developmental change. 
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day he must face anew the problems of 
living and seek fresh judgments and 
fresh solutions which incorporate the on- 
rushing developments of science. His 
course of action for the day cannot be 
selected until he has digested not only his 
breakfast but the morning press as well 
(and I add the pious hope that it may be 
the New York Times). 

The misuse of “Systematic” absolutes 
reveals its motivational origins when we 
compare it with related neurotic and psy- 
chotic mechanisms also used to handle 
anxiety. Here is the compulsive’s old 
friend verbal exorcism, where the anxiety 
producing properties of the probable error 
inherent in some learning experiment are 
rendered harmless and neutral by the 
mystical muttering of the magical words 
“secondary reinforcement.” Here is for- 
getting and the repression of the un- 
pleasant which leads our comparative col- 
leagues to imitate the tubular vision of the 
hysteric and concentrate their attention 
upon anal derivatives in the hoarding be- 
havior of the white rat to the complete 
exclusion of the problems surrounding 
the human collection of scientific data and 
its sublimational manipulation by due 
process of current statistics. There is 
also the phenomenon of contamination 
and interpenetration (familiar in our 
Rorschach practice) when we find non- 
directive therapy becoming confused with 
democracy and the defense of the Con- 
stitution of the United States. As for 
the use of neologisms—no wanderer in 
the mazes of current professional litera- 
ture needs to have this pointed out to 
him. Last, but by no means least, is the 
appearance of inappropriate emotion, 
whose turbulence ill becomes the public- 
library dignity of our scientific halls. 

It has always seemed to me that the 
dogmatism and intolerance of American 
behaviorism from Watson to Skinner re- 
veals an emotional potential above and 
beyond that to be expected in the pur- 
suits of pure science. Such an emotional 
charge suggests a need to be right, a need 
not springing from any narrow personal 
involvement, but from a deep desire to 
construct a basic system for the conduct 
of life and the control of society. To 
answer such a need the system must be 
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simple, workable, and at the same time 
infallible. Otherwise chaos may ensue, 
society may not be saved, and individual 
anxiety cannot be handled. In surveying 
Behaviorism one feels that the basic mo- 
tivation of the experimental work stems 
from the wish for a planned society, 
rather than the planned society follow- 
ing logically from the experimental work. 
Watson’s later work and subsequent writ- 
ing was definitely directed toward the 
practical control of human behavior, and 
Skinner followed his theoretical treatise 
with a literary formulation of a new be- 
havioristic Utopia. In reading Skinner's 
“The Behavior of Organisms” and_ his 
“Walden II,” one cannot help suspecting 
that the priority exhibited in the order of 
their publication is perhaps reversed in 
the author’s unconscious. 

The same spirit runs through much of 
American social psychology. In review- 
ing the work of my “Spissy” colleagues 
in the Society for the Psychological 
Study of Social Issues, I am reminded of 
Russell’s comment on __ philosophers: 


“Knowing, as they supposed, what be- 


liefs would make men virtuous, they have 
invented arguments, often very sophisti- 
cal, to prove that these beliefs are true.” 
The mission of American social psychol- 
ogy too often has been not a scientific 
one, but rather a religious one involving 
the experimental reinforcement of an 
a priori social ethic. In the deliberate 
choice of an experimental problem to be 
investigated, in the unconscious choice of 
experimental design, and in the sweep- 
ing generalizations often drawn from 
meager objective findings, this crusading 
social spirit is continually revealed. It 
has been marked not so much by good 
science as by science in a good cause. We 
are engaged not in the further discovery 
of the unknown, but in the justification 
of an a priori “given.” One cannot help 
feeling that social psychology today is in 
direct line of descent emotionally from 
New England transcendentalism and has 
inherited its ethical tradition. My own 
membership in the Society and my par- 
ticipation in the tradition attest to my 
approval of the ethic involved, but I can- 
not help but feel that I am behaving more 
as an emotional human being than as a 
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cold, impartial scientist. Both ethics and 
science have their place, but a confusion 
of their respective problems can easily 
lead to disaster in a world balanced as 
delicately as is ours today. The whole 
of social psychology can be viewed as a 
vast projective test whose results need 
careful clinical interpretation before they 
can safely be translated into social action. 

I would be false to my own thesis did 
I not point out in closing that the above 
remarks also must be interpreted in their 
psychological setting. They are not an 
impersonal statement of experimental 
findings. They are the very personal 
interpretations of a human organism 
which has had its own particular develop- 
mental history, and they must be heard as 
such. Their evaluation I leave to their 


audience. It is a common saying that the 
physician cannot heal himself. 

These are fundamentally problems of 
human dynamics, of the motivational ma- 
trix of human needs and strivings out of 
which our psychological theory and ex- 
perimentation have come. It is high time 
that psychology turns its interpretive in- 
sights on itself. This is a task for which 
clinical psychology is prepared, and a re- 
sponsibility which the teacher of clinical 
ysychology should be ready to assume. 
If we are successful, not only would psy- 
chology as a whole be benefited, but our 
special discipline of clinical psychology 
would be encouraged toward those 
broader horizons that we occasionally 
caught sight of during the recent weeks 
of the Boulder Conference. 
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ach January, the American Journal 
of Psychiatry carries a review of psy- 
chiatric progress for the preceding year. 
Writing for this review, Stanley G. 
Estes) was able to delineate progress in 
the field of psychometrics in 1947 with 
only a 20-item bibliography. For 1948, 
he accomplished this task by reference to 
only 18 papers“). For neither year were 
all of his references to research publica- 
tions. Of certain areas of research, e.g., 
structured personality inventories, he was 
extremely negligent. Aside from the ques- 
tion of representativeness, if the quan- 
tity aspect of Estes’ reviews were to bear 
any correlation to the true level of re- 
search activity, clinicians would have suf- 
ficient cause for concern. 

In an effort to achieve a more repre- 
sentative evaluation of research trends in 
the field of clinical psychology the writer 
has chosen to go directly to the journal 
literature, on the assumption that it is the 
most direct expression of actual research 

*From a paper given at the First Annual 
Conference of the Minnesota Psychological As- 
sociation, Minneapolis, April 1, 1949. 


activity as contrasted with “vest pocket 


projects.” This survey has been guided 
by an operational definition of clinical 
psychology as consisting of the activities 
of persons who work in face-to-face re- 
lationships with clients having problems 
primarily in the area of personality and 
adjustment. Such psychologists are con- 
cerned with the research development, 
administration and interpretation of psy- 
chometric instruments designed to de- 
scribe and measure maladjustment and its 
psychological correlates. They are con- 
cerned also with the development, appli- 
cation, and, in particular, the evaluation 
of techniques of therapy. 

The survey of the literature has been 
limited to the four journals most likely 
to carry research studies pertinent to clini- 
cal psychology as earlier defined: Jour- 
nal of Clinical Psychology; Journal of 
Consulting Psychology; Journal of Ab- 
normal and Social Psychology; and Jour- 
nal of Applied Psychology. The writer 
attempted a cursory tabulation under ap- 
propriate rubrics of the research contents 
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Types and frequency of research in clinical psychology appearing in four journals,* 


1946-48 











1948 Percent order of 
1948 19494 Total of total frequency 





Normative study (personality) 
Scoring technique (struc. & proj.) 
Validity study (projective) 
Normative study (intelligence) 

New projective tests 

Normative study (deterioration) 
Wechsler pattern analysis 

Test-taking attitude (personality) 
Abbreviated intelligence test 

Intertest relationships 

Analysis of test structure 

New scales (personality ) 

Psychol. of physically handicapped ... 
Analysis of recorded interviews 
Test-retest in normal, neurotics 
Personality correl. of physiol. changes 
New test (deterioration ) 

Test-retest of lobotomy 

Test-taking behavior (Rorschach) 
Non-direc. Rx, specific group 
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* J. clin. Psychol.(8) 


J. consult. Psychol.) 
+ First three months. 


of these publications for the three post- 
war years, 1946 through 1948. The clas- 
sification was essentially empirical rather 
than a priori, developing as the effort at 
tabulation proceeded. Twenty relatively 
distinct categories evolved although they 
are not highly refined, and the placement 
ot specific research studies was in some 
instances essentially arbitrary. Only those 
articles were classified which were clear- 
ly of a research nature, t.e., involving the 
systematic investigation of a specifically 
described group of subjects and the der- 
ivation of normative or comparative data 
from psychometrics, case histories, or 
therapeutic interviews, or analysis of the 
mechanics of administration, scoring, and 
interpretation of a given instrument. 

An analysis of the 154 tabulated studies 
(Table 1) yields several points worthy of 
comment. In the first place, a crude esti- 
mate was made of the total number of 
separate articles, exclusive of book re- 
views and short notes, carried by the 
four journals during the three-year in- 
terval. This estimate was based on an 
extrapolation from the exact data for 
1946 and is probably an underestimate 
of the true total. The tabulated research 
studies constitute approximately 20 per 


J. abn. soc. Psychol.(® 


J. appl. Psychol.(7) 


cent of this estimate of the total number 
of published articles. The true propor- 
tion is probably less than 20 per cent in- 
asmuch as the estimate of the total is 
probably somewhat niggardly rather than 
generous. It appears that over the three- 
year interval less than one-fifth of the 
contents of these four journals was de- 
voted to actual researches in clinical psy- 
chology. 

To some extent this very small propor- 
tion of research publications might be ex- 
plained as due to the post-war period of 
civilian relocation of clinicians during 
which time research activities were tem- 
porarily in abeyance. Were this true, it 
would be expected that research activities 
would be primarily conceived during 
1946, labored over in 1947, and published 
in 1948. This expected pattern of re- 
search activities would be verified by an 
essentially straight-line function of 
marked positive slope when number of 
studies is plotted against the three-year 
interval. Actually, the tabulation shows 
a total of 42 published researches in 1946, 
55 in 1947, and 57 in 1948. The propor- 
tion of the tabulated researches published 
in 1948 is less than 10 per cent greater 
than the proportion contributed in 1946. 
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These data suggest that a plateau, let us 
hope a temporary one, has been reached 
at a point which indicates only slightly 
greater productivity than that of the first 
post-war year. It must be recognized that 
an hiatus in research publication result- 
ing from the war, together with publica- 
tion lag, may fully account for the level 
of productivity suggested by the contents 
of the four journals, and that 1949 or 
1950 will show a great spurt in research. 
It is notable, however, that during the 
relatively arid interval which has been 
surveyed there is evidence that clinical 
psychologists have found time and moti- 
vation to engage in various symposia, to 
write numerous articles on problems of 
administration, training, ethics, interpro- 
fessional relations, and certification, and 
to contribute testimonials on new tech- 
niques. Does this mean that the incen- 
tive of wide government subsidy has 
served to make our field of psychology 
more conscious of its professional status 
than of its basic research and service re- 
sponsibilities ? 

The distribution of the 154 studies by 
general type of research gives reason for 
concern in terms both of the types of re- 
search having high frequency and. the 
types having extremely poor representa- 
tion. The category having the greatest 
number of studies is, reasonably enough, 
that labeled normative studies of person- 
ality, in which were tabulated all re- 
searches involving the investigation of a 
particular group or groups of subjects by 
means of a specific instrument and the 
publication of statistical norms. This 
category accounted for slightly over one- 
fifth of all the studies. Strangely, how- 
ever, the second most frequent category, 
one accounting for nearly 10 per cent of 
the tabulated studies, is that labeled 
“scoring techniques.” If this category 
represented exclusively studies devoted 
to the objectification and reliability of pro- 
jective instruments, in which the scoring 
of responses is a primary and difficult 
problem, there would be little cause for 
concern. The fact is, however, that a 
considerable portion of the articles repre- 
sented by this category are expositions of 
supposed shortcuts in the scoring of such 
structured instruments as the Minnesota 


SCHOFIELD 


Multiphasic and the Bernreuter inven- 
tories. The Multiphasic has particularly 
heavy representation in this category. 
Perhaps Corsini’s®) recent time-and-mo- 
tion study of the scoring of this: instru- 
ment and his demonstration of the com- 
parative efficiency of the originally pub- 
lished scoring procedures will discourage 
clinicians from further efforts of this 
oblique sort and channel their endeavors 
into the more crucial problems of cross- 
validation. 

The third most frequent type of re- 
search was concerned with the validation 
of projective techniques. Aside from the 
fact that the validity of an observational 
tool always is a respectable concern for 
any psychologist, it would appear to be a 
particularly healthy sign that the recent 
literature shows several efforts to ex- 


perimentally test the basic postulates con- 
cerning the behavioral correlates of re- 
sponses to such controversial instruments 
as the Rorschach and TAT. Williams’@° 
attempt to establish the dynamic relation- 
ship between certain of the Rorschach 
variables and adjustment to an operation- 


ally defined stressful situation has been 
deservedly commended as furnishing an 
excellent paradigm of the type of validity 
study which projective devices sorely 
need. Only after an operationally ade- 
quate demonstration of the validity or 
non-validity of the theoretical correlates 
of projective responses can there be hope 
for agreements in interpretation which 
will permit investigation of the clinical 
validities of projective instruments on a 
more rational basis than has previously 
been possible. It is to be hoped that en- 
thusiasm for such studies will not en- 
courage undue generalizations of their 
results to non-college samples and negli- 
gence of the need for cross-validation 
even at this relatively basic level. 
Enthusiasm for this apparent trend 
toward experimental validation of the 
older projective techniques is dampened 
by recognition of the rapidity with which 
new projective devices are being pro- 
posed. The fifth category of research 
studies in order of frequency is that of 
“new projective tests,” the data indicating 
an average of three new devices per year 
over the three-year interval. In view of 
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the fact that the nearly thirty-year-old 
Rorschach test is only now undergoing 
rigid experimental validation, one is not 
unduly skeptical to wonder if the prac- 
tical validation of existing projective tech- 
niques will ever catch up with the facile 
proposals of new ones. Perhaps work- 
ers of the future will look back on clinical 
psychologists of this period chiefly to 
marvel at our propensity for the construc- 
tion of incomplete sentences ! 

To round out a picture of the areas in 
which research has been concentrated, 
mention should be made of the remaining 
categories which rank among the first ten 
in terms of frequency and the per cent of 
the total number of researches which they 
include. These categories are, in order 
of frequency: normative studies of intel- 
ligence (6.5 per cent) ; normative studies 
of intellectual deterioration or brain dam- 
age (5.8 per cent); Wechsler pattern 
analysis in personality diagnosis (5.2 per 
cent) ; test-taking attitude as reflected in 
personality measures (4.5 per cent) ; ab- 
breviated intelligence tests (3.9 per cent) ; 
and inter-test relationships (3.9 per cent). 

Clinicians who work in a medical set- 
ting will be particularly impressed by the 
small amount of attention being given to 
the development of techniques for the de- 
tection of subtle psychological deficits of 
organic origin. This is admittedly an 
extremely difficult research problem yet 
one of great clinical importance. The 
alert neurologist eagerly seeks the assist- 
ance of the psychologist in the evaluation 
of those frequent cases in which there is 
a suspicion of encephalopathy although 
the neurological procedures yield nega- 
tive or at best ambiguous findings. None 
of the existent deterioration indices is en- 
tirely satisfactory. The clinician who can 
perfect a practical, reliable and reasonably 
fool-proof instrument or battery to fill 
this need will find it greeted by a recep- 
tion equal in warmth to that accorded the 
Binet-Simon scale. Yet, it appears that 
slightly more than one-twentieth of our 
research energies are being directed to the 
satisfying of this pressing clinical need. 

Particularly notable by their relative 
absence are researches designed to meas- 
ure the effects of specified forms of psy- 
chotherapy, to develop or investigate cri- 
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teria of personal adjustment or changes 
in such adjustment, to analyze the com- 
parative test-retest behavior of personal- 
ity tests in normals, untreated patient, and 
treated patient groups. The supposed 
stimulus to research on the structure and 
movement of therapeutic interviews pro- 
vided by the work of Rogers and his stu- 
dents has not yet been seriously reflected 
in published research by members of the 
opposing camp. The writer recently at- 
tended a national symposium on counsel- 
ing and psychotherapy which was spon- 
sored by the University of Illinois. Not 
until the evening of the first full day of 
the symposium, with the presentation of 
the sixth from a total of fourteen papers, 
did he hear the detailed report of actual 
research concerned with the development, 
reliability study and validation of a cri- 
terion for measuring the effects of a 
therapetitic program. Significantly, this 
study®?) was not done in a psychological 
clinic but rather in a social agency and in- 
volved not clinical psychologists but so- 
cial workers. 

The impetus to the field of clinical psy- 
chology which has arisen from the psy- 
chiatric burden of the war years has led 
most directly to federally and privately 
subsidized provision for the enlargement 
and improvement of training facilities. 
The immediate goal has been to increase 
the number of highly trained personnel. 
The ultimate goal, through the sufficiency 
of such personnel, is to increase the quan- 
tity and quality of research in the areas 
of mental hygiene and psychiatric ther- 
apy. In summarizing the fifty-year his- 
tory of clinical psychology, from 1896 to 
1946, Brotemarkle”) made the following 
statement : 


In 1946 it is most encouraging to see at hand 
the developing possibility of more extensive 
clinical research. Our training programs now 
include opportunities for practicum training in 
the form of internships. Institutions, schools, 
business and other agencies offering internship 
opportunities, are presenting evidence not only 
of the opportunity for research, but their in- 
sistence that well-planned comprehensive re- 
search must be undertaken. 


The optimism of this view does not ap- 
pear to have been justified by the extent 
and nature of research which has ap- 


peared through 1948. Possibly it is still 
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too early for the apparent, current ex- 
hilaration of clinical psychology to take 
permanent form in research contribu- 
tions. However, so far as the three im- 
mediate post-war years are concerned, 
and so far as the type of survey which 
has been attempted is adequately repre- 
sentative of the level and direction of 
overall research activities, clinical psy- 
chology would appear, to an uncomfort- 
able degree, to be a talking rather than a 
counting science. 
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With the recent publication of the se- 
ries of papers, A coordinated research in 
psychotherapy, by Rogers, Raskin, and 
their associates at the Counseling Center 
of the University of Chicago“, psycho- 
therapeutic research may be said, if not 
exactly to have come of age, at least to 
have got well beyond the teething stage 
and to have taken its first healthy strides. 
Certainly, nothing as mature as this se- 
ries of research papers has hitherto ap- 
peared from any other group of thera- 
pists ; and the painstaking attempts of the 
Chicago non-directive therapists to pro- 
duce a coordinated research project in the 
best traditions of systematically planned, 
objectified psychological experimentation 
are noteworthy ones that, it is to be hoped, 
will have many repetitions by other thera- 
pists of various schools. 

In view of the excellent start towards 
scientific research standards made by the 
Chicago group, it might seem presumptu- 
ous to cavil with the methodology or 
criteria employed in their published stud- 
ies. Psychological progress, however, has 
largely consisted of a long series of cavil- 
ings with even the most noteworthy and 
advanced research papers and theoretical 


concepts; and Rogers and his associates 
are among the first to acknowledge the 
existing shortcomings of their methods 
and the wide latitude which they’ still 
have for improving these methods. The 
remainder of this paper will therefore be 
devoted, not to disputing or attempting to 
destroy the research methodology so ef- 
fectively used in A coordinated research 
in psychotherapy, but to an attempt to 
suggest some additional research criteria 
over and above those outlined in the pub- 
lished papers. If, in the course of the 
ensuing discussion, the writer appears to 
be overly-critical of the research tech- 
niques of the Chicago group, this will be 
because these are the best available thera- 
peutic research materials, and lend them- 
selves far better for illustrative purposes 
than less explicitly defined and refined re- 


’ search methodologies. If the ensuing dis- 


cussion also seems to be overly-critical 
of non-directive therapeutic researches, 
rather than those of other schools of 
therapy, that too is because the non-direc- 
tive researchers have been most objective 
and progressive in their research presenta- 
tions; moreover, the writer has recently 
criticized at length the research (or lack 
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of research) methodologies of the psycho- 
analytic therapists“ 2), 

To establish psychotherapeutic research 
on a scientific basis, Seeman suggests five 
methodological steps : 


1. The electrical recording of cases. 
2. The definition of concepts which 
provide an understanding of these 
cases. 
The development of objective meas- 
ures of these concepts. 
The application of these measures 
to the same case material. 
The interrelating of the results of 
this application in order to (a) es- 
tablish the relationships existing 
between the concepts and (b) ob- 
tain a well-rounded picture of in- 
dividual cases‘*+ P- 215—Italics Seeman’s) | 


Accepting all these steps of Seeman’s 
as appropriate and necessary ones for the 
accomplishing of scientific research in 
psychotherapy, it is suggested that cer- 
tain other steps and procedures, which do 
not seem to have been adequately consid- 
ered or outlined by the Chicago group, 


are also desirable and necessary for the 
performance of objective psychothera- 


peutic research. Some of these additional 
methodological points will now be out- 
lined. 


1. Psychological researchers in thera- 
peutic areas must be especially cau- 
tious about naively accepting patients’ 
statements at their face value. Intro- 
spective evidence has been suspect 
ever since the earliest days of psycho- 
logical experimentation; but, for all 
its failings, it is utterly essential for 
investigations into therapy. Yet, the 
peculiar relevance of the patient’s in- 
trospections to the therapeutic (and, 
in the case of therapeutic research, the 
experimental) conditions cannot for 
a moment be ignored: else scientific 
disaster, as far as the conclusions of 
any therapeutic research are con- 
cerned, is almost inevitably courted. 
That is to say : while the ordinary psy- 
chological subject is not too ego-in- 
volved in the experiments in which he 
agrees to partake, and therefore has 
relatively little incentive for (consci- 
ously or unconsciously) exaggerating 
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or falsifying his reported introspec- 
tions, the therapeutic subject is most 
intimately involved in what Sullivan 
and his associates®) have called an 
interpersonal relationship with the 
therapist ; and every single one of his 
statements is consequently to be 
strongly suspect of parataxic distor- 
tion, transference effects, rapport in- 
fluences, or other incentives for distor- 
tion. 


For example, in the Chicago studies, 
Sheerer finds that “there is a definite and 
substantial correlation between attitudes 
of acceptance of and respect for self and 
attitudes of acceptance of and respect for 
others” P- 175). She and her associates 
fail to consider the possibility that this 
observed relationship, as well as several 
similar ones found in the studies, may be 
more a function of consistent patient at- 
titudes towards their counselors than to- 
wards themselves. 

Again, Raskin notes that significant in- 
creases in self-attitudes, self-acceptance, 
insight, and behavior, along with de- 
creases in defensiveness represent “a re- 
orientation of the client’s attitudes and 
behavior significant enough to be termed 
successful psychotherapy”: ? 215), Actu- 
ally, however, these reported attitudes 
and behavior of the patients may largely 
represent their efforts to obtain rapport 
with or love from their therapists; and, 
conceivably, they could represent over- 
dependence, and perhaps poorer person- 
ality integration of the patients. 

The main point to be made is that if 
investigators like Kinsey, who are frank-: 
ly interested in their respondents for ob- 
jective research purposes and who neces- 
sarily obtain only a mildly intimate rela- 
tionship with most of their respondents, 
admittedly have difficulties obtaining per- 
fectly truthful answers to ego-involving 
questions, psychotherapists who attain in- 
finitely more complex and intimate rela- 
tionships with their patients must under 
no circumstances accept these patients’ 
statements at face value, but must always 
seriously consider the hypothesis that the 
significant relationships observed among 
their patients’ verbalizations may in part 
be artifacts of the therapeutic relation- 
ship rather than objective evidences of 
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these patients’ innermost attitudes and 
feelings. 


2. 


In defining concepts for the under- 
standing of therapeutic cases, care 
must be taken to make these concepts 
maximally incisive and meaningful. 
The line of least resistance, which so 
often results in the production of 
highly objective, and highly wnim- 
portant, psychological researches must 
be consistently fought and conquered. 
Thus, although some of the concepts, 
such as insight and defensiveness, in- 
vestigated by the Chicago group are 
exceptionally meaningful and realistic 
in terms of actual problems of ther- 
apy, some of the other concepts, such 
as self attitudes, are rather vague and 
meaningless. To know, for example, 
that patients tend to make significant- 
ly fewer statements of their problems 
and offer more discussions oj their 
plans in the closing than the opening 
sessions of therapy is all very interest- 
ing (though hardly surprising). More 
to the point, it would seem, would be 
to discover whether they make more 
or less use of such dynamisms’as pro- 
jection, rationalization, identification, 
and compensation as therapy proceeds. 
It is to be hoped that because the ob- 
taining of information on the deeper 
dynamisms offers considerably more 
difficulty than obtaining information 
on simpler response categories, the 
former type of research is not to be 
neglected in favor of the latter. 


For the proper understanding of re- 
search reports, as well as for the en- 
couragement of experimental repeti- 
tions by subsequent researchers, fair- 
ly complete diagnostic or descriptive 
information on therapeutic research 
cases should be published along with 
the factual data. Unfortunately, the 
Chicago group has been surprisingly 
lax in this respect; and the result is a 
series of six research papers, present- 
ing considerable data for analysis and 
discussion, and nowhere including 
even a cursory description of the ten 
patients whose protocols are repeat- 
edly used in the investigations. The 
reader is told the age, sex, and num- 


ber of interviews with each patient 
but virtually nothing else. Indications 
as to whether the patients were seri- 
ously disturbed or mildly upset, 
whether they were vocational, scho- 
lastic, or emotional referrals ; whether 
they had any previous types of thera- 
peutic sessions; whether they were 
satisfied or dissatisfied with their 
counselors ; these and numerous other 
important questions concerning these 
patients are entirely unreported in A 
coordinated research in psychotherapy. 
Assuming that it is not the practice 
of the non-directive counselors in- 
volved in these researches to make 
specific diagnoses, it would still seem 
that the reader of their reports is 
entitled to clear-cut descriptions of 
(a) the patients’ symptoms upon and 
reasons for entering therapy; (b) the 
main feelings and attitudes of thé pa- 
tients towards their therapists and the 
counseling process; and (c) the con- 
dition and attitudes of the patients at 
the close of therapy. If these facts 
are lacking, it will be almost impos- 
sible for the reader to form his own 
evaluations of the objective data pre- 
sented, for the investigator to make 
suitable comparisons with other rele- 
vant therapeutic research studies, and 
for the would-be repeater of the in- 
vestigation to equate his experimental 
subjects with or compare them to those 
employed by the original investigator. 
Even assuming, therefore, that psy- 
chiatric and psychological diagnosis is 
considered to be largely or entirely 
irrelevant for therapeutic purposes by 
a given school of therapists, it would 
appear that it is indispensable to this 
school’s research investigations and 
reportings of therapeutic processes. 


It is vitally important that research in 
psychotherapy be specifically planned 
as research from the start, and that it 
be carried out in a truly cooperative 
manner. Although the Chicago 
group's researches were very well co- 
ordinated, they admittedly “just 
growed,” and were not originally 
planned in either a coordinated or a 
cooperative manner‘? P- 149), More 
to the point, perhaps, they consisted 
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entirely of investigations of therapeu- 
tic protocols rather than therapy pa- 
tients. Nor were they in any sense 
experiments in therapy; but, rather, 
ex post facto analyses of therapeutic 
sessions which had already run their 
normal course. 


Psychological experimentation has suf- 
fered too long from what might be called 
Ph.D.—itis: namely, the selection of re- 
search problems which are relatively easy 
to plan, to get subjects for, to use stand- 
ardized instruments with, and to amass 
neat-fitting quantified data about™). It 
is to be hoped that research in psycho- 
therapy will avoid following this too well- 
beaten path and will concentrate more on 
the truly difficult, and most pressing, 
problems of therapy: such as, which psy- 
chotherapeutic techniques are the most 
effective with what kinds of patients, and 
why? Granted that the answering of 
such questions requires long-term re- 
search planning, execution, and follow- 
up by fairly large groups of cooperatively 
working experimenters (no one of whom 
may be able to get individual Ph.D. or 
publication credit), there seems to be no 
practical alternative for arriving at un- 
equivocal answers to the most important 
therapeutic problems. While virtually 
all psychological research is, in the long 
run, instructive and useful, it is to be 
wondered whether contemporary _ re- 
searchers in therapy can afford the lux- 
ury of tackling relatively unimportant 
side issues when the solutions to the main 
ones are still so pressing and obscure. 


5. The problem of sampling is just as 
important to research in therapy as to 
other psychological experimentation, 
and should be adequately recognized 
and tackled. Thus, the protocols 
analyzed in A coordinated research in 
psychotherapy were taken from the 
recorded cases of only ten subjects, 
three of whom had only three thera- 
peutic sessions each and none of whom 
had more than nine sessions; these 
subjects all voluntarily accepted non- 
directive counseling, and nine out of 
ten were young graduate -or under- 
graduate students. Apparently, there- 
fore, the subjects of this coordinated 
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research project consisted of a highly 
specialized very small non-representa- 
tive group of patients ; and the gener- 
alizations which Raskin“: ?- 215) makes 
about successful psychotherapy on the 
basis of studies of these patients are 
to be accepted with extreme caution. 
It is to be hoped that future thera- 
peutic researches will include broader 
and more representative samplings of 
patients, or will confine their generali- 
zations to the types of patients sam- 
pled. 


While attempts at attaining quanti- 
fication and reliability of psychothera- 
peutic research data are certainly to be 
encouraged to the extent that they are 
practical and meaningful, concomitant 
qualitative and sequential analyses of 
sessions of psychotherapy should also 
be considered. Just as projective tech- 
niques like the Rorschach test cannot 
b> adequately interpreted only on the 
basis of the scoring determinants but 
also require content analysis, so do 
therapeutic sessions, to be fully evalu- 
ated and understood, require (a) con- 
textual consideration of each session 
as a whole; (b) consideration of each 
session in relation to all the sessions 
of a given patient; and (c) considera- 
tion of each and all the sessions in re- 
lation to the general background of the 
patient’s life and problems, all diag- 
nostic and other information which 1s 
available on the patient, and the per- 
sonality and problems of the therapist. 
While the contextual analysis of the 
patient’s statements and behavior, and 
their interrelationship to the gestalts 
of his entire therapeutic and life proc- 
esses, are admittedly difficult problems 
to undertake, it is hard to see how 
they can be eventually avoided if the 
major enigmas of psychotherapy are 
to be truly got at and solved. 


SUMMARY 


It may be noted, in summary, that the 
recent coordinated research project in 
psychotherapy by the Chicago group of 
non-directive therapists is a most heart- 
ening prelude to what may be expected to 
be eventual outpouring of objective psy- 
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chotherapeutic researches. If these re- 
searches are to be maximally productive 
and meaningful, however, it is to be hoped 
that they will go beyond the already pub- 
lished studies in their outlook and their 
methodologies. Specifically, it is to be 
hoped that researchers in psychotherapy 
from many different schools will give due 
consideration to projects that seek be- 
yond the mere verbalizations of the pa- 
tients; that make use of maximally in- 
cisive and meaningful psychotherapeutic 
concepts; that include adequate diagnos- 
tic or descriptive information on the cases 
studied ; that are planned from the start 
as controlled experiments in psychother- 
apy, and are executed in a truly coopera- 
trve manner; that take due account of 
sampling and generalizing to appropriate 
universes; and that, while paying ade- 
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quate attention to questions of reliability 
and objective quantification, also carry 
out necessary contextual, configurational, 
and qualitative analyses of the data ob- 
tained from the recording of psychothera- 
peutic sessions. 
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THE CONTENT OF MENTAL HYGIENE LITERATURE. 
NATURE OF IT 


Il. THE 


S DIRECTIVES 
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Hunter College 


INTRODUCTION 


A previous report®® evaluated the 
contemporary status of bibliotherapy, 
established the number of directives per 
page in four categories of mental hygiene 
literature, and discussed the significance 
of the directive content. The purpose of 
this supplement is to study the nature of 
the directives in the same sampling of 
popular and academic writing. 


MetTHop 


Analysis of the directives located in 
the sources listed in the biography of this 
paper, placed them in twenty categories.* 
A key word, a brief description when re- 
quired, and an illustration of each cate- 
gory follows: 

1. Anxiety. Worries, fears, phobias. 

“The worrier must substitute other 
behavior for worry” © »- 41), 


* Detailed data concerning directives obtain- 
able from author. 


2. Efficiency. Working quickly and 
effectively. “Clear your desk of all 
papers except those relating to the 
immediate problem at hand’’®: »- 215), 
Responsibility. Assumption of role 
in determining life's course. “It is 
very important to avoid unwhole- 
some attitudes of mind such as, 
‘What's the use of trying?’ to feel 
sorry for oneself, shirk personal re- 
sponsibility seeking pleasure 
only . . . 77, pm 26), 

Life goals. What one should strive 
for. ‘Beware of having somebody 
to live for and making too much of 
that person; select an enterprise to 
live for much larger than yourself 
and more likely to outlive you’ ? 
160). 

Methods. Ways to solve problems. 
“Analyze your bad habit”! Vol. 22, 
No. 1, p. 3) . 

Consultation. 
vidual 


The 
professional 


for indi- 
“Should 


need 
aid. 
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this not make you glad after all, con- 
sult a psychiatrist” P- 99), 
Occupation. “If you want a new 
sort of occupation, go get it’ P- 10%, 
Persuasion. Control over others. 
“*Don’t’ always calls attention to the 
forbidden act’’!5, P- 398), 

Philosophy. Religion, ethics, morals. 
“The sovereign cure for worry is re- 
ligious faith’ P- 243), 

Pleasure. Enjoyment of life. “Be- 
come aware of the present and try 
with all your energy to extract pleas- 
ure from it’’(11) Vol. 23, No. 1, p. 33). 
Psychosomatics. ‘Make sure you 
aren’t punishing yourself for guilt 
by ‘taking it out’ on your stomach” 
(i1, Vol. 22, No. 4, p. 35). 

Recreation. “Enjoy enough rest and 
relaxation’’(!9 P- 539), 

Relaxation. Release of muscular 
tension. “This (progressive relaxa- 
tion) can be done by having the sub- 
ject contract the muscles first, and 
then seeing whether he can experi- 
ence the muscle sensation due to this 
contraction’ P. 356), 
Self-confidence. “Assume an _atti- 
tude of self-confidence’’(® P- 49), 


Self-diagnosis. Evaluation of own 
mental health. “Jot down your skills 
and weaknesses, in two columns, then 
tackle the weaknesses’! Vol. 22, No. 
4, p. 101) 

Self-tolerance. Acceptance of “id” 
trends. “Acknowledge and face your 
anti-social impulses”, ?- 25), 
Self-understanding. Insight into dy- 
namics of personality. “Don’t for- 
get that every symptom ... isa 
symbol that stands for . . . some 
repression, complex, or conflict in 
the unconscious’’“! P- 9°), 

Sex and marriage. “lf young women 
wish to retain their allure for their 
husbands they should have regard 
for sexual modesty’’“!3: P- 299), 

Sleep. “Don’t let insomnia put you 
in a panic; don’t roll from one side 
of the bed to the other; don’t try to 
stop thinking’: P- 115) | 

Social. Adjustment to friends, as- 
sociates. “To make people like you, 
be a good listener ; encourage others 
to talk about themselves”: P- 95), 


A special count was made to determine 
the number of directives which were of 


Taste 1. Per cent of directives devoted to various topics in four samplings of 
mental hygiene literature* + 
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an unmistakably inspirational, “pep talk”’ 
nature. The twenty-first item, therefore, 
is not a separate category, but a descrip- 
tion of the manner in which directives 
were given: 


Inspirational. “Put your will to work; 
don’t falter and you can’t fail! All 
you have to do is keep at it long 
enough” Pp. 223), 


RESULTS 


The proportion of directives devoted 
to each topic was calculated for each unit 
sampled, and on that basis the average 
proportion for each type of literature was 
established. Table 1 summarizes the lat- 
ter findings. 


ANALYSIS OF STATISTICAL FINDINGS 


When three samplings of literature 
are grouped (Columns 2, 3, and 4) 
the four topics with the highest per 
cent of directives are: sex and mar- 
riage, methods, anxiety, and_ social. 
The lowest per cent is devoted to: 
recreation, consultation, sleep, and 
with identical scores — responsibility 
and relaxation.* Taken collectively, 
stress is on two of the most significant 
practical human problems, sex and 
social adjustment. Remarkably little 
is placed on the third area, that of vo- 
cational satisfaction. 
Topics in each of the top halves of 
Columns 2, 3, and 4 are: sex, meth- 
ods, self-confidence. Topics in each 
of the lower halves of these columns 
are: responsibility, recreation, self- 
tolerance, sleep, and consultation. 
When popular books and popular 
journals are grouped and compared 
with academic books, it is seen that 
sex, methods, and self-confidence re- 
ceived the most attention in both in- 
stances. Responsibility, sleep, recrea- 
tion, consultation, and_ self-tolerance 
received the least attention in both 
groups. 
With one exception all three cate- 
gories of literature deal at least to 
* The four texts on abnormal psychology are 
included primarily for interest and contrast; 
their total number of directives, only 10, is 
omitted in this summary 


some extent with each of the 20 
topics. (The exception is “relaxa- 
tion,” which—perhaps by chance in 
the sampling—had no directive de- 
voted to it in the popular journals). 
Popular and academic advice, when 
many literary units are grouped, is 
quite similar in its emphasis and wide 
in its coverage. It should be noted 
that these summary results do not 
reach the reader of the single unit, 
whose impression depends more on 
factors referred to in “5.” 

Single books and journals are char- 
acterized by enormous variability in 
the per cent of directives on each 
topic. One selected illustration is the 
fact that although sex and marriage 
is the highest ranking topic in every 
regard, three popular books gave no 
advice whatsoever on the subject: 7: 
». On the other hand a selected ex- 
ample of individual emphasis in a 
single unit is Dunlap’s“*) concern 
with directives on only 8 of the 20 
topics, with about 65% on sex and 
marriage. The designation ‘mental 
hygiene,” or any similar term, per- 
mits almost no conclusion about what 
the reader will find in a particular 
book or journal. It might be specu- 
lated that his confusion about how 
much advice he needed, and what sort, 
would increase directly with the num- 
ber of books and journals he reads. 
Inspirational advice of the lift-your- 
self-by-your-bootstraps variety, al- 
though it ranks highest in the popu- 
lar books, is almost non-existent in 
any category studied. Directives on 
“consultation,” the possible need for 
personal attention, are more concen- 
trated in popular than in academic 
units. Finally, academic books give 
more advice on self-diagnosis. These 
three findings might run counter to 
the untested beliefs of many psycholo- 
gists. 

Academic books have notably fewer 
directives on “social” and ‘“‘occupa- 
tion,” than are found in popular writ- 
ing. In this sense they may under- 
estimate their interest value and prac- 
tical significance to the usual reader. 
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CONCLUSIONS 


Analysis of the directives in three 
samplings of mental hygiene literature 
leads to these main findings: 

1. Popular and academic literature on 
mental hygiene, as a whole, is consistent 
‘o a considerable extent with respect to 
most-stressed and least-stressed topics. 

2. Single units of mental hygiene lit- 
erature, whether popular or academic, 
are distinctly individual products and the 
topics on which they concentrate advice 
varies greatly. 

3. Facile assumptions about differences 
between popular and academic categories 
may not only be false but reversed. 

4. A survey of mental hygiene litera- 
ture leaves a marked impression of arbi- 
trary emphasis and approach in each unit. 
It is submitted that the dignity of the field 
as applied science, as well as public con- 
fidence in it, would be increased by 
greater agreement among its writing prac- 
titioners. 
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ALTITUDE AS A REFERENCE POINT IN SCATTER ANALYSIS* 


MORDECAI WHITEMAN 


Delaware State Hospital, Farnhurst, Del. 


INTRODUCTION 


A number of measures have been pro- 
posed as internal reference points from 
which an assessment of intra-individual 
test discrepancies can be made. Babcock? 
and Rapaport’) have made extensive use 
of the vocabulary test for this purpose. 
Their rationale stresses two points: one, 
that vocabulary is relatively unaffected 
by mental disorganization, and two, that 
vocabulary is a satisfactory measure of 
intelligence. Criticism against the use of 
vocabulary as a special measure of intel- 
ligence is premised on the fact that since 
vocabulary is a verbal test, the intelli- 
gence level of non-verbally minded indi- 
viduals is under-estimated ©: !*), The con- 
tinual emergence of verbal ability as a 
group factor") also speaks against the 
acceptance of vocabulary as a sole measure 
of intellectual potentiality. 

A central tendency score is a second 

type of- widely used reference measure. In 
their psychometric patterning, Magaret‘’? 
and Wechsler“) have compared the dif- 
ferences of each individual's sub-tests 
from the mean of all scores in clinical and 
control populations. Rapaport‘ also uti- 
lizes deviations from a modified verbal 
mean and from the performance mean. Be- 
cause they are the results of averaging, 
means serve as fairly stable references. 
The gain in statistical stability, however, 
is offset by the psychological ambiguity of 
such a score. The averaging of unhomo- 
geneous measures has been criticized by 
Sabeock™) and Jastak®). Thurstone@!) 
has abandoned the practice in favor of 
presenting a number of scores, each hav- 
ing its own discrete psychological mean- 
ing. 

More recently, Jastak®: 5» © has intro- 
duced the concept of altitude as an aid to 
scatter analysis. By altitude, he refers to 
the top scores in an individual’s test bat- 
tery. On both theoretical and statistical 

*The author thanks Dr. Joseph Jastak, Chief 
Psychologist at the Delaware State Hospital, 
for his helpful suggestions for the preparation 
of this manuscript for publication. 


grounds, he conceives of altitude as the 
numerically derived representative of na- 
tive intellectual capacity and the clinical 
correlate of Spearman’s G factor. Intel- 
ligence, he defines as “the level of maxi- 
mum personality integration,” asserting 
that the optimum and not the medium is 
best indicative of the individual’s poten- 
tialities. Wide deviations between capac- 
ities and functional ability in life signalize 
maladjustments, as large discrepancies be- 
tween altitude and selective scores on psy- 
chometric batteries signalize disorganiza- 
tion. Hence the rationale for utilizing the 
highest scores as a reference point for 
scatter analysis. 

The problem of selecting a reference 
point is not merely one of methodological 
technique, but one that bears directly upon 
the broader problems of the nature of in- 
telligence and personality organization. 
The three types of reference points dis- 


cussed actually stand for three different 
measures of intelligence which, while cur- 
rent in clinical practice, conflict with one 
another at various methodological and 
theoretical levels. For example, mean and 
altitude proponents accept Spearman’s G 
factor, but disagree on what measure best 


represents it. However, the choice of a 
measure depends on the chooser’s con- 
ception of what this G factor is. If it is 
conceived as an ability, then the I.Q. is 
used. If conceived as capacity, then alti- 
tude is favored. Vocabulary and altitude 
proponents both stress intelligence as po- 
tentiality and consider test scores falling 
significantly below this potentiality as rep- 
resentative of mental inefficiency”) or ad- 
verse personality traits“. There is disa- 
greement over the procedures to be used 
in assessing this potentiality, but the va- 
lidity of these procedures hinges upon a 
clear-cut demonstration of their relative 
value in differentiating levels of intelli- 
gence independent of functional efficiency. 
As Chein®? puts it, “to bring back the 
concept of capacity to the realm of science, 

. . there must be some means of diag- 
nosing a capacity independently of its 
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being fulfilled.” Furthermore, the very 
selection of any particular reference point 
determines to a great extent the ensuing 
pattern of intra-test variability from which 
the clinician attempts to draw diagnostic 
inferences or personality pictures. Finally, 
in research work, the use of a standard 
vantage point that is practicable, statis- 
tically stable, and psychologically mean- 
ingful is indispensable for a direct com- 
parison of scatter studies. 

The purpose of this paper is to investi- 
gate the feasibility of using altitude as a 
reference point in the derivation of scat- 
ter patterns. 


METHOD ’ 


Population. Our control group consists 
of 50 white females who applied for 
nurse’s training at the Delaware State 
Hospital. The experimental group com- 
prises 50 white female patients diagnosed 
as schizophrenic at the same institution. 
Table 1 summarizes the age, educational 
level, and Wechsler-Bellevue 1.Q.’s of 
these two groups. 

Scoring. The weighted scores of the 
Wechsler-Bellevue sub-tests of each indi- 
vidual were transmuted into quotients by 
the following procedure. Each weighted 
verbal score was multiplied by 5, since 
there are five tests in the verbal cluster. 


TABLE 2. 





Deviation ratios from altitude 


The obtained result actually expresses the 
contribution this particular test score 
makes to the total weighted verbal score. 
The corresponding quotient is then found 
in the usual manner in Wechsler’s tables 
of verbal quotients under the individual’s 
age. Performance weighted scores under- 
go the same procedure, only the final quo- 
tient is found under the table of perform- 
ance quotients. This method, devised by 
Jastak, enables us to control to a great ex- 
tent the fluctuations of individual sub-test 
scores occasioned by age differences be- 
tween individual cases. 

Quotients from Jastak’s Wide Range 
Reading Test“) supplemented the stand- 
ard Wechsler-Bellevue battery. Twelve 
quotients were found for each case, eleven 
from the sub-tests of the Wechsler-Belle- 
vue, the twelfth being the reading quotient. 
To overcome the relative instability of 
single scores, altitude for each case was 
computed by averaging the three highest 
quotients in the individual battery. In 
order to give a proportionately heavier 
weight to those scores at the ceiling of the 
individual’s achievement, the highest score 
was weighted 5, the next highest 3, and 
the third highest 2. Each test quotient 
was then divided by its respective alti- 
tude to yield a deviation ratio, The use 
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1. Vocabulary 

2. Information 

3. Comprehension 

4. Similarities 

5. Digit Span 
Arithmetic 
Picture Arrangement 
Picture Completion 
Block Design 
Object Assembly 
Digit Symbol 
Reading 
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of ratios instead of differences serves to 
keep altitude uncorrelated with the test 
deviation and thus acts as a control upon 
mental age. 

Selective factors such as age, educa- 
tion, and choice of profession contribute 
to making the nurse’s group more homo- 
geneous in composition than the schizo- 
phrenic group. In a clinical setting, it is 
quite difficult to obtain a random sampling 
of normals to serve as a control popula- 
tion, which is why attendants, patrol- 
men, and nurses are so frequently utilized. 
However, since we are interested more in 
the nature of altitude as a scatter tool and 
as an intelligence measure, rather than in 
obtaining actual scatter norms, and since 
the nurses are undoubtedly a more stable 
group than the schizophrenics, which fac- 
tor should yield differential scatter pat- 
terns, it is believed that the choice of 
groups is justified by the direction and 
scope of the problem. 


RESULTS 


A comparison between the deviation 
ratios of schizophrenics and nurse appli- 
cants is presented in Table 2. 

The vocabulary and reading deviation 
ratios of the schizophrenics are reliably 
higher than the corresponding deviation 
scores of the nurses. Those tests whose 
deviation ratios are significantly depressed 
among the schizophrenics are comprehen- 
sion, arithmetic, picture arrangement, pic- 
ture completion, block design, object as- 
sembly and digit symbol. The similarities 
test shows a trend toward impairment 
among the patients, though the critical 
ratio fails to reach the 5% level of sig- 
nificance. 

To gain an estimate of the relative sta- 
bility of each of the different reference 
points in use, the significance of the dif- 
ferences between the standard deviations 
of altitude, vocabulary, the total 1.Q., the 
performance quotient, and the verbal quo- 
tient were computed. None of the ob- 
tained differences were significant. 

In order to compare the relative effec- 
tiveness of altitude and vocabulary as 
measures of intelligence, their correlations 
with total [.Q. are presented in Table 3. 

In both groups, altitude correlates more 
highly with I.Q. than does vocabulary. 


TasLe 3. Correlations between 1.Q., Vocabu- 


lary, and Altitude 








Nurses Schizophrenics 
ae Ee Bey | 





1.Q.—Vocabulary .... 45 .114 .82 .047 
1.Q.—Altitude 83 044 91 .027 
Altitude—Vocabulary. 43 .116 8&9 .028 





The higher correlations with I.Q. of al- 
titude is signficant at the 1% level (C.R.: 
3.00) even in the schizophrenic group. 


DIscussION 


The significant pattern deviations from 
altitude point to the latter’s practicability 
as a reference measure. Since there have 
been no previous studies reporting alti- 
tude scatter on the Wechsler-Bellevue 
among psychotics, opportunity for direct 
comparison of the above scatter patterns 
with those submitted by other investi- 
gators is limited. 

The fact that no reliable sigma differ- 
ences appear among the various reference 
measures in either schizophrenic or nor- 
mal samplings suggests that altitude is fully 
comparable to any of the extant reference 
scores in its limited range of variability 
within the groups studied. Variability is 
both an inter-individual and an intra-indi- 
vidual concept. The above results attest 
to the inter-individual stability of altitude. 
Equally pertinent, is the question of its 
intra-individual variability. The thesis 
that altitude is a valid measure of native 
capacity and not merely another conven- 
ient operational statistic depends in part 
upon the demonstration of its intra-indi- 
vidual constancy. This cannot be dem- 
onstrated in this study since sufficient re- 
test data are not available. It has been 
the clinical experience of Jastak, who has 
devised the measure, and of the writer, 
who has used it, that the altitude quotient 
is relatively impervious to either deteri- 
oration or improvement, even when suc- 
cessive testing discloses a loss or incre- 
ment in the individual’s global 1.0. How- 
ever, validity studies attacking this prob- 
lem remain to be done. 

The inter-correlations between _alti- 
tude, vocabulary, and I.Q. raise interest- 
ing points. In both nurses and schizo- 
phrenics, altitude correlates highly with 





ALTITUDE AS A REFERENCE POINT 


I.Q., and significantly more highly than 
does vocabulary. Here we have a measure 
whose absolute height is relatively uncon- 
taminated by the factors of functional 
efficiency implicit in the I.Q., yet whose 
directional covariation coincides even 
more closely than does vocabulary with 
an index of mental ability. These find- 
ings tend to support Jastak’s conception 
of altitude as a diagnostic measure of 
mental potentiality relatively free of dis- 
organizational factors, and furnish statis- 
tical evidence for its rationale as an effec- 
tive reference point. The question of the 
relative validity for the measurement of 
intelligence by 1.Q. as opposed to altitude 
is an important one in clinical practice. 
The correlation coefficient measures cor- 
respondence of directional variation 
rather than correspondence of absolute 
magnitude. Since the clinical assignment 


of an intelligence level is based on the 
magnitude of the diagnostic measure, in- 
telligence estimates are critically affected 
by the psychometric criterion utilized. For 
example, the average altitude score in the 
schizophrenic group is 104, whereas the 
average I. Q. is 79. 


It becomes obvious 
then, that even though the two measures, 
altitude and I.Q., are highly correlated, 
the very real magnitude discrepancies 
between them raise a serious diagnostic 
issue—which score best represents intelli- 
gence level? We can draw one inference 
regarding the relative worth of 1.Q. and 
altitude as intelligence measures which 
can be put to a test. If altitude measures 
intellectual potentiality, and I.Q. is a 
measure of functional efficiency, then the 
downward deviation of 1.Q. from altitude 
should be greater in a disorganized group 
than in a relatively stable population. This 
is indeed the case, for the average devi- 
ation ratio of 1.Q. from altitude in the 
nurse's group is 85.26, S.D. = 6.46, while 
in the schizophrenic group, the average 
deviation ratio of 1.Q. from altitude is 
only 75.40 with an S.D. of 9.12. The dif- 
ference is extremely significant (C.R: = 
6.26). It may be similarly argued that 
the discrepancy between vocabulary and 
[.Q. would be greater in the schizophrenic 
group than in the nurses, and that since 
vocabulary is relatively higher than I.Q. 
in the disorganized group than in the nor- 
mal one, a point is made for vocabulary as 
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a measure of intellectual potentiality. 
However, 38% of the nurses actually ob- 
tained I.Q.’s which were of greater magni- 
tude than their vocabulary scores. lt be- 
comes difficult to conceive of a poten- 
tiality or a capacity which is smaller than 
its fulfillment. Altitude is always larger 
than 1.Q., and in this sense fulfills an 
elementary requirement of the concept 
of potentiality if the latter is to have any 
consistent meaning, namely that poten- 
tiality be greater than actuality. 

The relatively low correlation between 
I. Q. and vocabulary in the nurses is un- 
doubtedly due to the strong homogeneity 
of this group. In larger, more heteroge- 
neous samplings, it is appreciably high- 
er‘. 19,12). The high correlation between 
vocabulary and altitude in the schizo- 
phrenic group suggests that much of the 
invulnerability of vocabulary among psy- 
chotics is due to its functioning as an alti- 
tude surrogate in psychotically disorgan- 
ized people. In non-verbal, psychopathic, 
and specially selected groups, the correla- 
tion between altitude and vocabulary is 
probably much lower. The lower cor- 
relation between the two measures in our 
selected normal group is in line with this 
supposition. It should be borne in mind 
that the very construction of the vocabu- 
lary test, apart from its validity or in- 
validity as a measure of intelligence, con- 
tributes to its high correlative properties. 
It contains a large number of carefully 
graded items; fine units of scoring are 
employed ; and its wide range of difficulty 
facilitates the tapping of correspondingly 
wide ranges of intellectual level. If other 
types of tests are to be compared with 
vocabulary as indices of intelligence, they 
should first be made equally reliable as 
technical tools. It is likely that all equally 
reliable tests correlate equally well with 
altitude in random samplings, though 
which tests emerge as altitude measures 
within specific individuals or discrete 
groups depends on those traits dominant 
within those individuals or groups. 


SUMMARY AND CONCLUSIONS 


In order to assess the value of altitude 
as a reference point, the Wechsler-Belle- 
vue sub-test deviations from altitude of 50 
schizophrenics and 50 nurse applicants 








‘ 
j 
4 
) 
: 
E 
. 
j 
; 
: 
: 
‘ 
% 
| 
4 
s 


164 R. B. AMMONS, P. R. ARNOLD & R. S. HERRMANN 


were compared. Significant differences 
were obtained. The stability, invulner- 
ability, and significance of altitude as a 
measure of intelligence were compared 
with those of the standard reference in- 
dices. 

It is concluded that within the limits of 
the size and selectivity of our experimental 
populations, altitude offers promise of be- 
ing a practicable, psychologically mean- 
ingful, and experimentally fruitful vantage 
point for the derivation of scatter patterns. 
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INTRODUCTION 


General verbal ability is closely related 
to general intelligence. For this reason, 
intelligence tests have almost always in- 
cluded an appreciable number of verbal 
items. The two most widely used clinical 
tests of general intelligence at the school 
level are the Revised Stanford-Binet@” 
and the Wechsler - Bellevue“?). Each 
makes important use of verbal items. Un- 
fortunately for many uses the Stanford- 
inet calls for reading at Year 10, and 
1. Acknowledgment is due Mr. Neil W. 
Coppinger, Mrs. Helen S. Ammons, and Mr. 
Newell H. Berthelot-Berry of Tulane Univer- 
sity for reading the manuscript critically and 
offering many helpful suggestions. The test 
and manual with final scale norms, answer 
sheets, and instructions for administration) 
can be obtained from R. B. Ammons. 


takes approximately an hour to admin- 
ister. In addition, the variety of tests 
often makes interpretation of the pattern 
of “passes” difficult in terms of the sub- 
ject’s possible ability or experience. The 
Wechsler’s usefulness is limited in that 
it should probably not be used regularly 
at ages below 12, and its standardization 
group for the upper part of the school 
range was not directly controlled for 
socioeconomic status. 

Various kinds of vocabulary questions 
have proven to give better measures of 
verbal ability than any other sort of ver- 
bal item. Both Stanford-Binet and 
Wechsler vocabulary subtests show the 
highest correlation of any subtest in the 
scales with the whole scale _ scores. 
Spache) has independently determined 
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the correlation between the MA’s from 
the Stanford-Binet vocabulary test and 
the full scale MA’s to be .92. 

No really satisfactory scale using only 
vocabulary items has as yet been con- 
structed and standardized. Such a test 
should not depend on reading ability or 
a facile flow of speech. It should cor- 
relate well with measures of general 
ability, and take only a short time to give. 
With these considerations in mind, the 
senior author considered a _ variety of 
vocabulary items, and concluded that the 
multiple-choice picture vocabulary form 
used by Van Alstyne“!) was the most 
promising. A set of 16 4-picture plates 
was developed, and a preliminary scale 
seemed to work well in practice’), On 
this basis a program was set up for de- 
veloping and standardizing a scale for 
use at all age levels©: © 7) and with spe- 
cial groups, such as farm“) and Spanish- 
American®? children. 


PROBLEM 


The purpose of this study was to de- 
velop two forms of a picture vocabulary 


test using the 16 4-picture plates provided 
by Ammons and Huth), and suitable for 
measuring the auditory comprehension 
vocabulary of school children 6 to 17 


years of age. To set up the final forms, 
the following steps were necessary: (a) 
discovery of a large number of poten- 
tially useful items, (b) testing of a rep- 
resentative school-age population, (c) 
selection of items for the two final forms 
of the test, (d) evaluation of these forms 
as to reliability and validity, and (e) 
calculation of norms for future use based 
on the scores made by the standardiza- 
tion group on the items making up the 
final forms. 


PROCEDURE 


Materials. The 1937 Stanford-Binet vo- 
cabulary words“ were listed on a spe- 
cial form allowing enough space to record 
answers in full. In giving the Full- 
Range Picture Vocabulary Test, the 16 
4-picture plates developed by Ammons 
and Huth™ were used. The pictures are 
cartoon-like line drawings representing a 
considerable variety of life situations. 

A large number of items related to the 
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pictures was needed. The concept of each 
item was supposed to be represented by 
only one picture of the four on a given 
plate. Forty-eight items were available 
from a previous study“), and the stand- 
ardization personnel were able to list 243 
more by examining the pictures and 
working through a dictionary. Group 
discussion eliminated 43 of these, and 
the remaining 248 were roughly pretested 
by administering them to 48 white chil- 
dren,’ 2 boys and 2 girls from each grade, 
1 through 12, which children had been 
judged to be of about average ability by 
their teachers. 

Passes for each word at each age level 
were tabulated. A running average 
based on five age groups at a time was 
calculated. From this a 50 per cent pass- 
ing point was estimated for each word, 
i.e., the age in the age succession at which 
approximately 50 per cent of a group of 
children would be expected to pass. 
Since the vocabulary test of the 1937 
Stanford-Binet nad also been given, the 
difficulty of the items could then be ex- 
pressed in terms of the estimated MA 
level corresponding to the 50 per cent 
passing point. 

On the basis of the number passing in 
each age group 22 more items were dis- 
carded, leaving 226 for the standardiza- 
tion scale. An item was considered in- 
adequate if it discriminated poorly be- 
tween successive age levels, showed sex 
differences in difficulty, or was defective 
in some qualitative way. A testing form 
was arranged with the whole series listed 
in order of difficulty by card. (Of the 
226 items used in the standardization test- 
ing, 157 had estimated difficulty levels 
in the age range fronr6 to 17 years.) The 
total list is given in an article by Ammons 


and Rachiele“), where a more detailed 


2. The authors were fortunate in having the 


help of the following Denver public and paro- 
chial school personnel in obtaining children for 
pretesting and standardization: Claude B. Pen- 
dleton, Roy Hinderman, Harry Nicholson, 
Maurice Ahrens, Guy Fox, Joseph M. Lort, 
Eugenia M. Kaupp, George E. Hook, William 
L. Miller, Margaret McGinley Murray, Alvin 
Yordy, Rev. Edward A. Leyden, Sister Anna 
Joseph, Peggy Chambers, Sister Mary Owen, 
Sister Mary Salome, F. Allan Murphy, and 
Robert Colwell. Without their generously 
given assistance, this project could never have 
been undertaken, much less completed. 
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TABLE 1. Number of subjects of each sex tested at each age level, with mean 


chronological age in years for each group 
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explanation of the item selection method 
is also presented. 


Subjects. A total of 360 children were 
tested, but the 11 at the 18-year level 
were discarded because it was impossible 
to keep the sampling at this school level 
unbiased according to the sampling cri- 
teria. The age distribution of the re- 
mainder of the group is shown in Table 
1. Fifteen boys and 15 girls were tested 
at each grade level. 

Only those children considered by the 
school to be in the proper grade for their 
age group were taken. This grade level 
control led to the unequal numbers by 
ages shown in Table 1. 

Father’s occupation was carefully con- 
trolled by grade, as shown in Table 2, 


TABLE 2. 


Occupational group of father* 


Professional and semi-professional 
Farmers and farm managers 

Proprietors, managers and officials 
Clerical, sales, and kindred workers 
Craftsmen, foremen, and kindred workers 
Operatives and kindred workers 

Service workers 

Farm laborers and foremen 

Laborers, except farm and mine 


Total 


in the same way as described by Ammons 
and Holmes“) for the pre-school-age 
group. It will be seen that there is a 
fairly close correspondence in occupation 
between this group of fathers and em- 
ployed white males in the United States 
who are heads of families. The farm 
children in this study (3 boys and 3 girls 
at each grade level) were tested sepa- 
rately), but their test results are used to 
complete the sample. Children with no 
fathers, unemployed fathers, or fathers 
with unreported occupations were ex- 
cluded from the sampling. All the city 
children were taken from the public or 
parochial schools of Denver, while the 
farm children were tested in a rural area 
in Nebraska“). 


Percentage of present school-age population tested with fathers falling 








Estimated 
census 


per cent} 


Per cent 
tested 
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* Classification taken from the 1940 census (13a). 
+ Computed from the 1940 census (13b), Table 16, families with employed head, by 
major occupation group of head, by tenure, for the United States. 
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Testing. Children were tested during 
school hours in special rooms provided 
by the cooperating schools. Once suitable 
rapport had been established by conversa- 
tion, the picture vocabulary testing was 
begun. Words were asked for one plate 
at a time, and always for the plates in the 
same order, from 1 to 16. 

Since all people in the standardization 
project 4 5. & 7) were expected to ad- 
minister some tests at each general age 
level, a standard set of instructions was 
prepared“), The subject was told that 
all he had to do was to point at the one 
picture out of four on the plate before 
him which the word described. The pro- 
cedure was then tried out with several 
simple words, until it was clearly under- 
stood. It was explained that there were 
no time limits. Guessing was not al- 
lowed, and the subject was instructed to 
say “I don’t know,” if he didn’t. It was 
explained that there were words for 
adults on the cards, so that there would 
be many he could not give an answer for. 

Easy words were asked whenever the 
examiner thought this would raise morale 
and prevent guessing. If a subject 
seemed to hesitate before pointing, or 
give any other indication of guessing, he 
was asked why he had chosen the picture 
he had, asked to define the word verbally, 
or the item was asked again later as a 
check. These procedures seemed to 
eliminate guessing in all but a few cases. 
Evidence for this can be found in the 
numbers passing by ages for the various 
items, where the numbers somewhat be- 
low the 50 per cent passing point were 
zero or nearly so, whereas 25 per cent 
of the subjects would have answered cor- 
rectly by chance if all had been guessing. 
Starting at the subject’s estimated level 
of ability, words were given until three 
consecutive levels had been failed and 
three passed. 

When the picture vocabulary test had 
been completed, the 1937 Stanford-Binet 
vocabulary test was administered, accord- 
ing to standard instructions. 


RESULTS 


Responses were tabulated by items and 
age groups, and the per cent passing at 


each age level was calculated for each 
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item. A 50 per cent passing point was 
determined by interpolation between the 
two adjacent age levels which showed per 
cents passing above and below 50 re- 
spectively. In tabulation, all items be- 
low the three levels consecutively passed 
by a given subject on a plate were scored 
passed ; and all items above the three con- 
secutively failed were scored failed. 

Selection of the final items was now 
made. It had been decided to keep 8 
words at each age, 6 to 16, or a total of 88 
out of the original 157 available. An item. 
analysis was done to eliminate the words 
which most poorly discriminated between 
successive age levels, those showing dif- 
ferences in difficulty between the sexes at 
beyond the 5 per cent level of confidence 
by a chi-square test, several which referred 
to more than one picture on a plate, those 
with a regional bias, some which showed 
more subjects passing at lower age levels 
than at higher, and some which duplicated 
concepts better tested by the same or a 
similar word on another plate. No 
word was kept which had been found to 
be inadequate at the preschool®) or 
adult” level. 

It was now discovered that there were 
few than 8 satisfactory items at the 8&-, 
1l-, 12-, 14-, and 15-year levels. This 
was remedied by borrowing from ad- 
jacent levels with a surplus. This ac- 
tually made little difference in the 
average difficulty of items at a given 
level, since only items close to that level 
were borrowed. For example, since only 
7 words were available at the 8-year level, 
“sale” at the 7.9 year level was included 
to fill out this level. All items remain- 
ing beyond 8 at a level were eliminated in 
order of their unacceptability according 
to the previously mentioned selection cri- 
teria. Although the 17-year level was not 
included in the final scale, two words 
from it were borrowed to fill out the 16- 
year level. It was found that adult level 
3 was equivalent to the 17-year level, so 
that when adult levels 1 and 2 were 
omitted, the items could be ranged on a 
continuous~scale of difficulty, 14, 15, 16, 
A3, A4, ete. 

Two forms, A and B, were now con- 
structed, by taking four words at a time 
from the list by difficulty, and assigning 
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them to the scale according to the scheme 
ABBA. The final items are given in the 
test manual“). 

Kkach subject’s score was determined on 
each final form by counting the items 
passed, including those at the preschool 
and adult levels, and all those below the 
three-consecutive-pass level on each plate. 
The correlations of picture vocabulary 
with Binet vocabulary scores were com- 
puted separately by forms and age groups. 
These were quite yariable, due to the 
small numbers involved, but showed me- 
dians of .67 for Form A and .69 for 
Form B, with no tematic sex differ- 
ence. It was fet that these might be at- 
tenuated due to thé unreliability of the 
criterion, the inet vocabulary score. 
Consequently. the odd-even reliabilities 
corrected to#full length of the Binet 
vocabulary were computed separately by 
age groups. These ranged from .50 to 
91, with a median of .80. The obtained 
validities for the picture vocabulary test 
based on its correlations with the Binet 
were thus reasonably high, and corrected 
for the attenuation of the criterion, they 
were very high. The odd-even reliabili- 
ties of the picture vocabulary test varied 
from .50 to .99 with a median of .81. The 
reliability for the full range of talent was 
987. Here again there were no signifi- 
cant form or sex differences. 

Table 3 gives the mean scores by form, 
age-level, and sex. 

There were no significant differences 


between sexes or forms. The steady 


TABLE 3. 


Form A 
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Mean* S. D.¥+ Mean S.D. 
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progression from age to age is another 
indication of the validity of the test. 
Final norms“) were prepared by smooth- 
ing the values given in Table 3. 

The mean Binet vocabulary scores of 
the present sample and those estimated 
for comparable age levels in the original 
Terman - Merrill standardization group 
were compared. There is a slight but 
statistically unreliable tendency for the 
present group to score higher, but this is 
probably due to the method of estimating 
original Binet vocabulary scores which 
was rather rough™). 3 


DIscuUSSION 


Certain limitations of the present sam- 
pling procedure are apparent. Since only 
children who were in the correct grade 
for their age were tested, the upper and 
lower extremes of ability were excluded, 
and the group variability in picture vo- 
cabulary scores was decreased. Group 
variability in scores was increased by in- 
cluding a variety of ages within any age 
group, i.e., age 7 could include children 
7 years 0 months to 7 years 11 months. 
The group was taken from only two 
localities, and to the extent that the chil- 
dren of persons engaged in specific oc- 
cupations in Denver and a farm area in 
Nebraska are not representative of those 
whose parents are engaged in the same 
occupations elsewhere in the country, the 
present sample is not representative. 

These limitations are not serious. 


As 


Mean scores for Form A and Form B of the Full-range Picture Vocabulary 
Test according to age level and sex for the 


present school-age standardization group 


Form B 
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Mean S.D. 
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pointed out elsewhere, the representa- 
tiveness of a sample is only relative, as 
are the norms based on it. The present 
group is certainly representative of a 
large proportion of the white school-age 
population of the United States. It might 
be pointed out that Wechsler’s sample of 
school-age individuals was taken from a 
limited number of schools in New York 
City, and is certainly of an indeterminate 
representativeness. In any case, the ac- 
tual validity of the present test will rest 
in the last analysis on clinical experience. 
It is interesting to children, easy to ad- 
minister, and reliable in its estimates of 
verbal ability. It should be mentioned 
that the pictures can be used to obtain 
personality information by questioning 
the child’s spontaneous expressions of in- 
terest and emotion or asking him to tell 
stories. 
SUMMARY AND CONCLUSIONS 

A preliminary scale of 226 words based 
on the plates of the Full-Range Picture 
Vocabulary Test was administered with 
the Revised Stanford-Binet vocabulary 
test to 360 white children, 15 boys and 
15 girls at each grade level from 1 to 12. 
The sample was controlled for the occu- 
pations of fathers. A set of 88 items was 
selected on the basis of this group’s per- 
formance, divided into two forms, and 
combined with items from the preschool 
and adult levels to make up the final Full- 
Range Picture Vocabulary Test. Re- 
liability based on intercorrelation of the 
forms was .987 for the whole group, and 
the forms correlated well (.67 and .69 
uncorrected for the unreliability of the 
criterion) with the 1937 Stanford-Binet 
vocabulary test. Norms are given for 
ages 6 to 16. 

In view of the reliability and validity of 
the test, its high interest value and short 
time of administration, and its provision 
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for a simple non-verbal way for the child 
to answer, it should prove valuable in the 
field of individual clinical measurement 
of verbal ability. 
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INTRODUCTION 


Since its publication twelve years ago, 
the Bender Gestalt Test has received in- 
creasing attention as a projective me- 
dium. In 1938, Bender wrote “The final 
product (of copying forms) is a visual 
motor pattern which reveals modifications 
in the original pattern by the integrating 
mechanism of the individual who has ex- 
perienced it”). Since then, the problems 
concerning the application of the test have 
been resolved as tollows™ : 


1. Establishment of an objective scor- 
ing scheme. 
Extraction of the meaningful factors 
from the final results. 

3. Relation of the above to the person- 
ality organization of the individual. 


The purpose of this paper is to offer 
a solution to the first two of these. A scor- 
ing method is proposed, the results of 
which are correlated to various factors ob- 
tained from the Rorschach test. 

The history of the use and application 
of the Bender test has been amply re- 
ported by Billingsleaa®. A summary of 
the methodology and results obtained in 
these studies, is, however, of some interest. 


1. Some attempt was made to separate 
and classify meaningful items of per- 
formance, 

The categories thus obtained were 
both qualitative and subjective in na- 
ture. 

The question of reliability was not 
investigated. 

Validity was considered only in terms 
of the differential classification of 
clinical groups such as neurotics ver- 
sus normals, psychotics versus neuro- 
tics, ete. 

The results of the validity studies 
were questionable at best. 


Billingslea’s own approach represents, in 

part, a radical departure from the preced- 

ing investigations. Following an analysis 
*Harvard Medical School 


of the conceptual foundation of the test 
he devised and developed an objective 
method of scoring based upon an elabo- 
rate system of factors and indices. Three 
of the factors, closure, total rotation, and 
size difference, showed evidence of statis- 
tical reliability via the split half technique. 
Validation, by a comparison of the results 
made by groups of normals and selected 
neurotics was, in general, unsuccessful™). 


THEORETICAL CONSIDERATIONS 


In order to consider adequately the 
problems of scoring and validation it is 
necessary to refer to some of the theory 
underlying projective techniques and per- 
sonality dynamics. According to the 
most generally accepted concept of per- 
sonality a continuum is presumed to exist 
between the ‘“‘most normal” and the ‘most 
abnormal”“®), The nosological categories 
of clinical diagnosis represent an arbi- 
trary classification system which may or 
may not be justified in fact. Certainly, it 
is unwarranted to assume that a test is 
capable of making such distinctions in va- 
cuo™®), It is more logical to expect that a 
projective technique yields evidence of the 
personality structure by means of be- 
havioral manifestations, in one form or 
another. The clinician supplies the “label” 
—if and when indicated. Furthermore, 
within each category, e.g., schizophrenia, 
there exists great diversity in individual 
personality organization. Since test re- 
sults vary accordingly, the evaluation of 
the meaningfulness of individual factors 
within their inter-relationships become as 
important as the consideration of the total 
performance™®), 

In general, physical and psychological 
events may be understood either as con- 
vergent or divergent phenomena accord- 
ing to the conceptual formulation and 
methodology employed. The former 
may be called the psychometric approach. 
It studies the regularities of behavior in 
terms of individual differences, establishes 
central tendencies and group norms, and 
utilizes classical statistical methods in 
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order to develop group relationships. The 
latter point of view is inherent in most 
modern personality theory and in our un- 
derstanding of projective methods. Per- 
sonality is considered to be an active, dy- 
namic, stratified, and structured whole 
which interacts with its environment“), 
Any facet of this interaction reveals and 
reflects the whole but may be interpreted 
accurately only in light of knowledge of 
the entire personality’. Stated in terms 
of the immediate problem, the validation 
of data obtained from projective tests 
should be attempted through integration 
with all the data available on the indi- 
vidual personality, rather than through 
statistical treatment of group results. 

The introductory phase of the applica- 
tion of a testing method does require 
postulation of a classificatory scheme, and 
correlation with known variables. But, it 
must be remembered, sth a breakdown is 
artifactual and is useful only for the deter- 
mination and extraction of meaningful ma- 
terial. The final check of validity can be 
obtained only by following the criteria dis- 
cussed above). 


Metuop 


Administration. The standard Bender- 
Gestalt figures supplied by the American 
Orthopsychiatric Association were used. 
A pencil with an eraser and a supply of 
white, unlined 844” by 11” paper were 
presented to the subject, with the follow- 
ing instructions: “I am going to show you 
a series of diagrams, one at a time. What 
you are to do is to copy these diagrams 
just as you see them on the cards”). The 
first card was then exposed, followed by 
the second when the subject completed the 
first to his satisfaction, etc., until the test 
was completed. <All questions were an- 
swered either by, “draw them just as you 
see them,” or by “do what you think best.” 
No drawing aids of any kind were per- 
mitted. 

Immediately after the completion of the 
Sender Test, each subject was given a 
Rorschach, according to the usual meth- 
ods for individual administration. Each 
record was scored by the method outlined 
by Klopfer and Kelley[®. 

The subjects consisted of a group of 
sixty college undergraduates who had vol- 
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unteered for an extended program of test- 
ing), 


Scoring Method. Size deviations from the 
stimulus figures were measured according 
to the twenty-five indices listed in Table 1. 
The unit of measurement chosci: was 0.1 
inch since it was large enough to allow for 
coarseness in drawing and since the di- 
mensions of the stimulus figures were 
found to be integral multiples of this unit. 
Graph paper ruled ten units to the inch 
was found to be a very convenient measur- 
ing device. Standard scores were com- 
puted for the deviations and the standard 
deviation (V score) and algebraic total 
(D score) were calculated on the basis of 
these for each of the subjects. 


RESULTS 


The intercorrelations of both the V and 
D scores with selected Rorschach scores 
are presented in Table 2. It may be noted 
that statistically significant correlations 
were obtained with the V score and the 
following: sum C, .27; sum (CF + C), 
.28; M plus sum C, .o+; M plus sum (CF 
+ C), .37; and the “new F%,” —.27. 
None of the correlations involving the D 
score was significant, but those which 
merit consideration are as follows: M, 
0.23; M plus sum C, 0.22; W%, —0.24; 
and R, 0.22. 

A reliability coefficient was obtained 
through the split-half technique by cor- 
relating the sum of the indices starred in 
Table 1 with the sum of those remaining. 
The resultant correlation was .85 and with 
the Spearman-Brown formula .92. The re- 
sults, therefore, appear to be highly re- 
liable. The correlation between the V and 
D scores was .38. 


DiscUSSION 


Size variations in the Bender test may 
be evaluated in several ways. First, vari- 
ation may be considered in terms of the di- 
rection of the deviation from the dimen- 
sions of the stimulus figures. The sum of 
the individual scores obtained from each 
index yields the overall tendency toward 
contraction or expansion for each subject. 
This is measured by the D score with posi- 
tive quantities indicating expansion, and 
negative quantities contraction. 
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Taste 1. Indices for evaluating B-G responses 


Stand. Fig. 
Dimension 





Description of Index—M easured in Terms 


Fig. Index of Deviation from the Standard Figure 





a I* Vertical diameter of circle 1.0” 
II Horizontal diameter of circle : 0 
III* Vertical diagonal of diamond A 
IV Horizontal diagonal of diamond A 
I Length from first to last dot 
I Length of figure (horizontal) 
Il* Width of figure (vertical) 
I Length of figure (horizontal ) 
II* Width of figure (vertical) 
I* Vertical side of rectangular figure (mean) 
I] Horizontal side of rectangular figure 
III* Altitude of curve 
IV Distance between points of inflection of curve 
Base of curve 
II* Altitude of curve 
Length of horizontal 
Width of horizontal (mean) 
Length of vertical 
Width of vertical (mean) 
Length of left hand (tilted) figure 
Width of left hand (tilted) figure 
Length of vertical figure 
Width of vertical figure 
Length of figure 
Width of figure 
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Another measure of size variation is in- 
tra-individual variability in the actual per- 
formance. The size of the first figure 
drawn provides a pattern or frame of ref- 
erence for the drawing of the second fig- 
ure, the size of the first two for the third, 
and so forth. The standard deviation, or 
V score, represents this intra-individual 
variability within performance. 

In the Rorschach, M is considered to be 
a manifestation of ‘“‘promptings from 
within” and the sum C, responsiveness to 
stimulation from without’®. At the high- 
est level of abstraction, both the move- 
ment and color responses represent a re- 
action to aspects of the blot other than the 
obvious form elements“: 15), Conversely, 


TABLE 2. 


sum sum sum 


the “new F%,” a score proposed by Rapa- 
port’), is a measure of adherence to pre- 
dominantly form elements. The signifi- 
cance of the color responses is heightened 
by substituting sum (CF +. C) for sum C. 
The FC responses are more closely allied 
to the tendency represented by the “new 
F%,” and are, in fact, included within it. 

The success in discrimination of these 
tendencies by the V score may be found in 
Table 3. Two groups were selected, one 
composed of the five subjects with the 
highest V scores, and the other group, the 
five making the lowest scores. The aver- 
age M plus sum C and the average “new 
*%” were calculated for each group, and 
the critical ratios were computed. The 


M plus 


FC (CF+C) C (CF+C) sumC W% F% 
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N = 00. 
* Significant at the 5% level. 
+ Significant at the 1% level. 
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differentiation of M plus sum C (r = .34) 
was significant at the 1% level of con- 
fidence. The “new F%” (r = —.27) was 
differentiated at the 5% level. 


TasLe 3. Critical ratios between high and low 
" scores 





Low V P 





Score 


High V 





M plus 
sum C 


new 
F% 





N= 10. 


TaBLe 4. Critical ratios between high and low 


M plus sum C scores 








High 
M plus Sum C 


Low 
M plusSumC t P 


Score 





V 8 7 
D +6 —l1 


N= 10. 


118 x 
1.00 x 





Taste 5. Critical ratios between high and low 
“new F%” scores 








High 
“new F%” 


Low 
“new F%” 


Score 





V a 9 
D 20 23 





N= 10. 


Prediction of the V score by M plus 
sum C and by the “new F%” is shown in 
Tables 4 and 5 respectively. The groups 
were chosen by the same method used for 


the computation of Table 3. None of the 
critical ratios so obtained was significant. 
It is possible, therefore, to predict the 
Rorschach variables by the V score, but 
not vice versa. 

Apparently, variability in performance 
is due, in part, to the interaction of the 
forces toward form adherence and to those 
against it. It is apparent, further, that the 
Rorschach does not measure all of the fac- 
tors contributing to this variability. In 
general, however, it may be stated that the 
greater the V score, the greater the degree 
of distractibility from the “form aspects” 
of the task presented. : 

Since no significant correlations were 
found for the D score, discussion of its 
meaning must be confined to conjecture. 
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It may be directly related to the produc- 
tivity of the subject as indicated by R 
(r = .22). The M responses measure a 
distinct type of psychic activity—the in- 
terpretation of imbalance in the stimulus 
as movement“), Since M and the D 
score are positively correlated (r = .23), 
the tendency toward figure expansion 
could be related to this activity. The 
negative correlation with W % is certainly 
unexpected in light of our present under- 
standing of the nature of W and merits 
more extensive investigation. 


TasLe 6. Critical ratios between high and low 
D scores 








High 
Score D 


Low 





M + sum C 


“new F%” 82 





N= 10. 


Tasie 7. Critical ratios between high and low 
(CF + C) and FC Scores 








Low 
(CF+C) 
High FC 


High 
(CF+C) 
Low FC t 
1.33 x 
2.70 <.05 


Score 





V 0.7 0.9 
D —10 +4 


N= 10. 





Discrimination of D and Rorschach 
scores by the selection of the highest and 
lowest groups was unsuccessful, as illus- 
trated in Tables 4, 5, and 6. One excep- 
tion was found by comparing the subjects 
who scored high in CF + C and low in 
FC with those who scored low in CF + C 
and high in FC (Table 7). The average 
of the former indicated expansion and that 
of the latter, ‘contraction. The critical 
ratio was significant and well within the 
5% level of confidence. Thus expansion 
appears to accompany uncontrolled affect 
and contraction, controlled affect. This 
relationship between figure size and emo- 
tionality is certainly not inconsistent with 
previous studies 14, 29), 

It must be emphasized that due to the 
limitations within the experimental proce- 
dure itself, many pertinent personality 
factors have remained completely unevalu- 
ated. The results obtained should not and 
do not represent evidence for or against 
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the validity of the Bender Test. They do 
reveal the presence of meaningful material 
which will require further study for the de- 
termination of its actual significance. The 
general method for such investigation has 
been discussed above. Immediate possi- 
bilities for further research include the de- 
velopment of a more sensitive scoring sys- 
tem, and use of more directly relevant 
criteria for validation. 
SUMMARY 
An objective scoring method is pro- 
posed tor the Bender Gestalt test based 
upon deviation of the results from the 
standard figures. 
The scoring method was found to have 
high reliability. 
The V score which measures intra-in- 
dividual varigbility is related to the 
degree of adherence to, or departure 
from form elements. 
The D score, representing tendencies 
toward expansion or contraction of the 
test figures, seems to indicate the rela- 
tive control or lack of control of affect. 
Theoretical problems involved in vali- 
dation are discussed and suggestions 
are made for further study. 
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INTRODUCTION 

The classical Gestalt-theorie states that 
relationships are a secondary product of 
analysis of the primary total form inherent 
in sensory-perceptual activity, and that 
they are not fundamentally dependent up- 
on either learning or broad experience. To 
this postulate, Bender “’) adds the concept 
that the sensory-perceptual-motor _ re- 
sponse is a personal function, dependent 
upon the maturational level and the in- 
tegrative status of the organism. This ex- 
ploratory study deals with the Bender 
postulate that the personal response is 
based upon the individual’s maturational 
level. Specifically, it is an exploration of 
the corollary thesis that a child who is 
making satisfactory progress in reading 
must be at a maturational level where 
sensory-perceptual-motor activities more 
closely resemble those of adults than they 
do the responses of pre-readers. 


PROBLEM 


The study reports the results obtained 
from the administration of the Bender 
Visual Motor Gestalt Test to two groups 
of normal children: the first group being 
30 children in the Pennsylvania State Col- 
lege Nursery School who have not com- 
menced to read; the second group being a 
random selection of 30 children in the sec- 
ond grade in State College, Pennsylvania. 
All the children were rated by the ex- 
perienced teachers in charge as “normal 
children.” One group had made satis- 
factory progress in reading; the other 
group was composed of pre-readers. The 
problem was that of finding out how these 
two groups differ in their reproductions of 
the nine Wertheimer figures comprising 
the Bender Test. As a tentative hypothe- 
sis, it was conjectured that the responses 
of the readers would more closely re- 
semble those of adults than would the re- 
sults obtained from pre-readers. In other 
words, it was supposed that there would 
be a significant difference when the, re- 
productions of these two groups were 


compared. The results were first classified 
according to the categories outlined by 
Hutt). 

RESULTS 


The findings are presented in table 1 be- 
low: 


Taste 1. Percentage of distributions of re- 
Sponses on the Bender Visual Motor Gestalt 
Test for two groups of young children 


Percentage of frequency 


Readers 
N= 30 


Pre-readers 


Determinant N= 30 








Order : 
Logical 73% 
Confused ‘ 0% 
Irregular 27% 

Expansion 40% 

Use of margin 58% 

Size reduction 86% 

Condensation and simplifi- 

cation 

Angulation 

Curvature modifications .. , 

Perseverations 58% 

Closure effects 97% 

Overlapping y 3% 

Elaboration Y 0% 


93% 
42% 
81% 





It appears that the pre-readers were en- 
tirely neglectful of the requirements of an 
orderly procedure in reproducing the fig- 
ures and that incorrect sequences and 
chaos were characteristic of their re- 
sponses. By contrast, the readers were 
cognizant of the need to proceed in orderly 
fashion, somewhat analogous to the meth- 
ods followed by adults. Correlated with 
the relative disorderliness of the repro- 
ductions by the younger group was the 
tendency to spread the drawings hap- 
hazardly over the page in an expansive 
manner. The utilization of the margin to 
keep the figures well-spaced was neglected 
by most of the younger children in the 
pre-reading stage, whereas more than half 
of the second-graders were directed by 
marginal aspects of the field. It is also 
clear that the younger children were far 
less likely to reduce the size of the Gestal- 
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ten than the older ones were. Both groups 
tended to simplify the figures to make 
them easier to reproduce. This fact may 
be attributed to the imperfect co-ordina- 
tions of the children at these maturational 
levels. It is significant to report that none 
of the pre-readers followed the require- 
ments of horizontal or vertical axes, but 
that nearly half of the older ones did. With 
this finding it could be predicted that there 
might be similar differences in imposing 
modifications of curvature. The facts, 
however, indicate that many children in 
the older group modified the curvatures 
and that all the younger ones did. Per- 
severative effects were somewhat more 
noticeable in the reproductions of pre- 
readers; and, similarly, there was some 
difference in the introduction of Gestalt 
closures. Both the overlapyings of figures 
and the tendency to introduce syncretistic 
elements were of more frequent occurrence 
in the reproductions of the younger chil- 
dren than in those by the readers. 

It will be obvious to the psychologist 
familiar with developments in the clinical 
use of the Bender that Hutt’s categories 
have been modified to suit the needs of 
this investigation. Since the study deals 
with children properly classified as “nor- 
mal,” the psychopathological implications 
of the Hutt categories were not considered 
in making these classifications. It is of 
significance only to note in this investiga- 
tion that the requirements of the objective 
situation tend to appear more obviously in 
the work of children who can learn to read 
than in the work of those who are still 
too young to commence the primer. Al- 
though the findings indicate that both 
nursery-school children and second-grade 
children have imperfect muscular co-ordi- 
nations, there are statistically valid dif- 
ferentiations revealed by the Bender. In 
rank-order of superiority the older chil- 
dren excelled in the following characteris- 
tics: orderliness of general procedure in 
performing the tasks ; absence of syncretis- 
tic effects; freedom from overlapping one 
reproduction upon another ; and an avoid- 
ance of an increased size in the reproduc- 
tions. 


DISCUSSION 


When normal second-grade children are 
compared with children at the nursery- 


school level, there are obvious differences 
in maturational levels revealed in Gestalt 
reproductions. The task-oriented  re- 
sponses may be partly attributed to the 
effects of school training in the older 
group. A considerable amount of work in 
paper-pencil situations has been done by 
the time a child reaches the end of the 
second school-year. This fact, naturally, 
may be of considerable moment in the im- 
position of the more realistic approach to 
Gestalt reproductions. On the other hand, 
the uniform testimony of experienced 
teachers supports the statement that a cer- 
tain level of maturation must be attained 
before a child is able to observe these 
classroom requirements. In particular, the 
voluminous literature on the “minimal 
reading age” would confirm the thesis that 
more is involved than mere school train- 
ing. The maturational factor is clearly 
demonstrated in this comparative study of 
readers vs. pre-readers. In fact, it is 
justifiable to say that the Bender Visual 
Motor Gestalt Test may be employed as a 
measure of a pupil’s readiness to benefit 
by the realistic demands of the curriculum. 
When, in other words, a child’s reproduc- 
tions of the Gestalten more closely re- 
semble those of an adult than they do those 
of a pre-reader, the child is likely to be 
regarded by experienced teachers as “nor- 
mal primary-grade material” and fit to 
profit by the “normal” curriculum of the 
school. 

An outstanding feature of the drawings 
is that those done by children in the sec- 
ond grade display obvious evidences of a 
self-critical attitude towards work of this 
type. Erasures are almost totally absent 
from the drawings of the pre-readers, but 
they occurred in many instances among 
the productions of the older children. A 
slower, more deliberate pace was also 
noted as a characteristic of the perform- 
ances by the older group. In the evalu- 
ations of all the productions by both 
groups of children, the investigator found 
a marked hiatus. By the method of “blind 
arrangement,” the work of the pre-readers 
could be readily differentiated from that 
of the “normal readers” in second-grade 
primers. In particular, the work of the 
more matured group displays a greater de- 
gree of objectivity and adaptation to the 
demands of the situation. Younger chil- 
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dren, on the other hand, did not seem to 
respond to the Wertheimer figures in any 
way suggestive of the manner of normal 
adults. Their reproductions are charac- 
terized by highly subjective, personal 
elaborations, omissions, and idiosyncra- 
cies. Both the inadequate neuro-muscular 
co-ordinations of the pre-readers and their 
unrealistic approach to task-oriented work 
may account for this hiatus. 
CONCLUSIONS 

Appraisal of the Bender Visual Motor 
Gestalt Test results shows that there are 
significant differences in at least four ma- 
jor determinants when five-year-old and 
seven-year-old “normal” children are com- 
pared. These variances may be accounted 
for in part by the fact that the older chi'- 
dren have had more training in _task- 
oriented work, with standards imposed by 
adults. In large part, however, they seem 
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to be the result of important differences 
in maturational levels. The sensory-per- 
ceptual-motor responses of children in 
the second grade tend to resemble those 
of adults. The responses of children in the 
nursery school exemplify idiosyncratic 
examples of syncretistic behavior. In other 
words, reduction of autokinetic effects is 
the most obvious cause for the differences 
which may be observed in a comparative 
study of this type. 
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INTRODUCTION 


This paper is the outgrowth of a psy- 
chometric study of patients who had suf- 
fered focal brain damage and in whom 
the locus of the lesion had been ascer- 
tained either by surgery, e¢.g., in cases of 
brain tumor, or, in gun shot wound cases, 
by x-ray demonstration of metallic for- 
eign bodies in the brain. The patients 
studied were all male patients at the Min- 
neapolis Veterans Administration Hos- 
pital, 

The results reported here are concerned 
only with the multiphasic profiles of the 
following two sub-groups of brain-dam- 
aged patients: A) Sixteen cases with 

1. Published with the permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 
pressed nor conclusions drawn by the authors. 


frontal lobe lesions and, B) twenty-seven 
cases with parietal involvement. In 
Group A, the lesions were, in all cases, 
confined to the frontal lobes, but Group 
B was a somewhat more mixed group in 
that some of these patients had lesions 
which extended to more than one lobe, 
though in all cases the common denomi- 
nator of “parietal involvement” was pres- 
e:'. With respect to laterality, there were 
approximately the same number of right 
and left hemisphere lesions. 


PROBLEM AND METHOD 


The analysis described herein was per- 
formed to test the hypothesis that there 
are no significant differences between the 
Minnesota multiphasic profiles of the pa- 
tients with frontal lobe lesions and the 
profiles of those patients with lesions in- 
volving the parietal lobe. 
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brain damage involving the parietal lobe. 


In analyzing the differences between 
the two groups, two methods were em- 
ployed: 1) mean T scores for each group 
were obtained on all scales, and tests were 
done to determine the statistical signifi- 
cance of the differences which appeared ; 
2) profiles were “coded” by the ranking 
method described by Welsh®) and the 
mean ranks for all scales were computed 
for each patient group. The results ob- 
tained by these methods are presented in 
Figures 1 and 2. 


DISCUSSION OF RESULTS 


Inspection of Fig. 1 shows that the 
mean T score on the K scale is significant- 
ly higher for the group of patients with 
frontal lobe lesions. However, on the F, 
LD), Pt, and le, seales the parietal involve- 
ment group had significantly higher mean 
‘T scores. 

With respect to variability, the follow- 
ing differences were noted: on the L 
scale, the frontal lobe group is significant- 
ly more variable; on Hs, Hy, and Ie, the 
parietal involvement group is the more 
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The mean T score profiles for 16 cases of frontal lobe brain damage and 27 cases of 


variable. A possible reason for the great- 
er variability of the parietal involvement 
group on the clinical scales is that this 
group is a more variable group with re- 
gard to location of brain damage. For 
the frontal lobe cases all had lesions ex- 
clusively in the frontal lobe, while the 
parietal lobe cases showed overlapping of 
lesions into other lobes and were thus not 
as pure a group neurologically. 

An interesting fact is that the differ- 
ences in mean T scores which have been 
referred to above, suggest that the pa- 
tients with parietal involvement have 
more severely disturbed personalities than 
do the patients with frontal lobe lesions. 
In addition to and complementing this 
difference in severity, there is also a dif- 
ference between the two groups in type 
of personality involvement. The mean 
profile for cases of frontal lobe injury ex- 
hibited a V-shaped neurotic triad (1.e., 
the Depression score is below those of 
Hypochondriasis and Hysteria). There 
is also a secondary elevation on the 
Schizophrenia scale. The “composite” 





PSYCHOMETRIC LOCALIZATION 


PROFILE CHART 


Hy, Pa M: 


0.5 
1.5 
2.5 
3.5 
4.5 
5-5 
6.5 
7.5 
8.5 
95 


wrDewW oP ok 


Mean ranks 4.3 
(frontal ) 

Mean ranks 3.6 
( parietal ) 


Fic. 2. 


Pp PRP SS. 


Lo 


44 63 8 
4.8 6.3 7.6 


The mean rank profiles for 16 cases of frontal lobe brain damage and 27 cases of 


brain damage with parietal lobe involvement, illustrating relative scale relationships in contrast 
to the absolute T score relationships shown in Fig. 1. 


profile code of the frontal lobe cases (us- 
ing Welsh’s method of coding, ref. cit.) 
is: 3184265790. From this profile, one 


might conjecture the mean personality 
type of the frontal group to be capable of 
description somewhat as follows: accept- 
ing, non-irritable, not anxious, affable, 
easy going, and possessed of a relatively 


low general level of aspiration. This de- 
scription does, in fact, fit the most com- 
mon clinical picture observed among the 
individual patients in this group. 

The mean profile for the patient group 
with parietal lobe involvement is quite 
different from the profile just described. 
Here, the neurotic triad scores present an 
inverted V-shape (with D high) and the 
secondary peak is on the Psychasthenia 
scale rather than on the Schizophrenia 
scale as is the case in the frontal lobe 
group. When we consider individual 
cases, a higher proportion of markedly 
abnormal profiles are found among the 


parietal involvement group. Profiles cap- 
able of being interpreted as normal are 
far more common among patients with 
frontal lobe damage than among patients 
with parietal involvement. 

The Welsh profile code for the parietal 
group is: 2713890465. This profile might 
be interpreted as reflecting an “anxiety 
neurosis” type of personality: i.e., rigid, 
worrying, pessimistic, hyper-active, pre- 
cise and detail-bound. As a group, the 
patients making up this parietal involve- 
ment group appear more sensitive to anx- 
iety-producing environmental situations 
than are the frontal lobe patients or than 
are normal individuals without brain 
damage. This sensitivity and the general 
anxiety-prone personality type are clini- 
cally observable in many individual cases 
in the parietal involvement group. This 
type of personality is rare, if not non- 
existent, in the frontal lobe group of pa- 
tients. 
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The differences observed between these 
two localization groups suggest the pres- 
ence of some cerebral localization of the 
reaction patterns which influence the be- 
havior of an individual in response to his 
environment and which are reflected on 
MMPI records. Of interest in this con- 
nection, for the purposes of comparison, 
are the mean MMPI profiles published by 
Hovey“. His composite profile for cases 
of dissociative-conversion reaction has a 
marked resemblance to that presented in 
this paper (Fig. 2) for cases with frontal 
lobe damage. Hovey’s composite profile 
for cases of anxiety neurosis, on the other 
hand, resembles the profile presented 
herein (Fig. 2) for cases of brain damage 
with parietal involvement. 


N. 


BROWN 


SUMMARY 


The results of a study of MMPI profiles 
of patients suffering focal brain damage 
are presented. Characteristic T score and 
pattern differences are shown between 
patients with frontal lobe lesions and 
those’ with parietal involvement. The 
former group is shown to have both psy- 
chometric and clinical indications char- 
acteristic of the hysteroid type of reac- 
tion pattern ; the latter group most closely 
resembles patients suffering with anxiety 
neurosis. 
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INTRODUCTION 


A primary place among personality in- 
ventories in clinical diagnosis and voca- 
tional counseling is being attained by the 


Minnesota 
ventory. 


Multiphasic Personality In- 
Its 550 statements constitute 
most of the more important questions 
asked a patient in an initial psychiatric 
examination. Apart from an analysis of 
the profile, the clinician or counselor can 
profitably inspect responses to individual 
items, using the Inventory somewhat like 
a questionnaire. 

The MMPI is completed by the patient 
answering each of the statements as 
“true or mostly true,” or “false or not 
usually true,” as applied to him®. He 
relegates certain cards to the Inventory’s 
Cannot Say division when the item does 
not apply to him, or if it is something he 
doesn’t know about. However, the client 

*The opinions expressed are those of the 
writer. They do not necessarily reflect the 
viewpoint of the Veterans’ Administration. 


s urged to resolve every test item as either 
True or False. 

The total number of cards put in the 
Cannot Say group make up the Question 
or ? score. It is a validating score, and 
its size “ . affects the significance of 
the other scores. Large Question scores 
invalidate all others. A ‘borderline’ Ques- 
tion score probably means that the sub- 
ject’s actual score, if he had not used the 
Cannot Say category at all, would devi- 
ate farther from the average than his ob- 
served score indicates”. 

T tables have been set up for the raw 
scores on each scale of the Inventory. A 
score of 1 represents one statement or 
card that appears in the counting. A 
Question score of 30 or less counts as a 
T value of 50, or “normal.” Still con- 
sidered within the normal range, rating a 
T of 69, is a raw score of 100, represent- 
ing 100 cards placed in the Cannot Say 
group. Hathaway and McKinley con- 
sider that “Question scores above the 
borderline T score of 70 should be taken 
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as a sign of invalidity, and some allow- 
ance should be made in the range of 60- 
70'7(2). 

The authors of the MMPI stress the 
importance of making sure that each 
single card is in the box (individual 
test), when the examinee is through 
working on the Inventory. This diligence 
is entirely warranted. And _ yet, the 
client can eliminate many cards from 
scoring consideration simply by isolating 
them in the ? section. This article sug- 
gests that certain ? cards be included in 
the scoring of-the clinical as well as the 
validating scales, and presents a rationale 
and trial procedure for doing so. 


RATIONALE OF THE ? CATEGORY 


We see a large number of Inventory 
items omitted from scoring by the “either- 
or” logic of the Cannot Say device. The 
? unit appears to have its reason for be- 
ing in the following assumptions: If the 
patient cannot, or will not (same thing ?), 
decide whether a particular statement is 
either true or false, or if it does not per- 
tain to him, then it is neither true nor 
false, and should be left out of the scor- 
ing scheme. It is proposed, as an hy- 
pothesis, that certain ? items be regarded 
as having some truth in them. This rea- 
soning is used: That which is not entirely 
true, or mostly or usually true, and yet 
is not entirely false, is partially true. 

Under what circumstances does an 
examinee place cards in the Cannot Say 
compartment? Among the several rea- 
sons that may be conjectured, these seem 
to merit special attention: 


1. The items do “not apply to him,” or 


“he doesn’t know” about them. 

examples follow: 

a. Item B-50—My people treat me 
more like a child than a grown-up. 
To a mature man who had left the 
parental home years ago, and had 
not been in close contact with his 
relatives, such a statement would 
not apply. It may have been an- 
swered in the affirmative if it re- 
lated to an earlier period of his 
life. But testees are supposed to 
answer the statement in the tense 
in which it is presented. > 


Two 
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b. Item J-26—I liked “Alice in Won- 
derland” by Lewis Carroll. This 
statement may possibly be one that 
the client doesn’t know about, or 
does not remember as to whether 
he liked it or not. 

Patients unable at times to be decisive 
even in clear-cut issues are likely to 
fill up the ? category with their patho- 
logical irresoluteness. The MMPI 
Manual recognizes that “In its own 
right the Question score is an indica- 
tor of personality factors, but no 
specific clinical material on it has been 
analyzed. High scores have often 
been observed to occur in psychas- 
thenia and retarded depression pa- 
tients.” 

The examinee falsifies a card by de- 

claring that he cannot say whether it 

is true or false, when he really can or 
should be able to. 


? 


At this point, a brief discussion of ly- 
ing on the MMPI is in order. The 
L(Lie) scale provides a measure of the 
extent to which the client tries to falsify 
by presenting a socially approved picture 
of himself. In other words, his tendency 
to put particular statements that are true 
for him into the False group, and vice 
versa. But perhaps it is just as much a 
lie when he places a card, that represents 
a true situation for him, in the ? section. 
As none of the latter cards are ever re- 
placed into the Inventory’s scoring, the 
L scale to that extent is limited in its 
measurement. 

The three reasons suggested above, of 
course, do not exhaust the listing of pos- 
sible motivating factors behind the ex- 
aminee’s rejection of MMPI items. But 
they are probably the main ones. 


ScorING SELECTED ? ITEMS 


It would seem, therefore, that the only 
? cards that should really remain un- 
scored are those first discussed above— 
those that do not apply to the patient or 
that he doesn’t know about. The others, 
it is postulated, should be returned to the 
scoring scheme. (Hereafter in this ar- 
ticle, “—?” will refer to a ? card that is 
not to be returned for scoring, and “+ ?” 
to the ? statement that is.) 
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Just which statements placed in the 
Cannot Say division should be given a 
—? value? There is a number of such 
items relative to family relations, for in- 
stance, which would not pertain to a ma- 
ture adult who had severed family ties 
years before. Item B-50, mentioned 
earlier, is a sample. Generally, most of 
the items in the B 47-55 group, and those 
numbered C 1-16, might be considered in 
this respect. 

Once the exact cards that qualify for 
the —? group are selected, they can be 
inconspicuously marked. A red or black 
dot on the back of the card may serve to 
identify it. In using the individual test 
(box of cards), experimental scoring 


could be done thus: 


1. Take out all the cards that have been 
put in the Cannot Say department. 
Discard all those with the special mark 
on the back, the —? cards. 

For each remaining +? card, enter 
a ? mark on each line of the record 
sheet as indicated by the card’s num- 
ber. No entries are made for the —? 
statements discarded. 

When applying the template for the 
particular Inventory scale to be scored, 
count the ? marks that correspond to 
either X’s or O’s on the key. But 
while valuing each of the regular 
scored items as 1 point, experimentally 
rate each scored ? mark as % point. 
The total of the ones and the one- 


halves would then be the raw score for 


the specific scale. 


The reason for assigning a trial value 
of % to the ? mark scored is this: Those 
True and False cards which qualify for 
scoring have each a value of 1. The +? 
card is considered as falling somewhere 
between this point and zero, and half- 
way between is a logical trial point. 

In the usual scoring procedure, then, 
a ? mark is entered on the record sheet 
for each card in the Cannot Say section, 
without separating the cards. When a 
question mark is aligned with an X on 
the template, it is not scored. When con- 
tingent to a 0 on the key, according to 
Krise“) and others, it not counted 
either because the cell is not actually 
blank. In the proposed plan, on the other 
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hand, the Question cards are sorted into 
—?and +? groups. The —? items are 
not entered on the record sheet. Only 
the +? cards are, with the usual ? mark 
as the entry symbol. While in the present 
MMPI scoring system no ? mark is ever 
counted, each such mark in the experi- 
mental plan is given a % value when 
eligible for scoring on the individual 
scale. 

All of the cards in the individual test 
have either the lower right or lower left 
corners cut off. Only those cards put in 
the True section with the right corner 
cut off, and those in the False group with 
the left corner severed, are actually 
counted. They are statements that are 
in the “abnormal” direction, as distin- 
guished from the others, discarded and 
unscored, which are in the “normal” or 
expected direction. The following exam- 
ple illustrates the principle which places 
+? cards from the Cannot Say division 
into the counting scheme, irrespective of 
which corners are cut off: 

Item A-46—I have few or no pains 
(left corner missing). The statement is 
within the experience or knowledge of all 
persons, and every examinee is expected 
to resolve it as being true or false. When 
the card is placed in the True compart- 
ment, it does not enter into the final count- 
ing because it denotes a normal response. 
If sorted in the False unit, it indicates an 
abnormal condition and scores 1 point. 
But if isolated in the Cannot Say parti- 
tion, it is omitted from scoring altogether 
just as if it had been regarded as true. 
Since it is a statement that every client 
“knows about,” it assumes +? signifi- 
cance when thus sorted, and is scored, 
but at % value. This principle of the 
-++ ? item appears to hold true for the clini- 
cal, validating and corrective scales alike. 

So far, discussion has centered on the 
individual MMPI test, the box of cards. 
The plan advocated here, for scoring 
+? items, is equally applicable to the 
group form. On the latter, the patient 
reads each statement from a booklet, and 
marks appropriate spaces on an answer 
sheet for True or False responses. When 
he ‘cannot say” on an item, he enters no 
mark on the answer sheet for that state- 
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ment. Experimental scoring of the group 
test can be performed in this way: 


1. Identify each statement left blank on 
the answer sheet, having —? value, 
by a dot or other sign next to the item 
number. (The statements not to be 
replaced into the scoring scheme from 
the Cannot Say section are now seg- 
regated. ) 

With a colored pencil, fill in the blank 
spaces under both the True and False 
columns of the remaining blank state- 
ments. (This assures scoring of the 
+-? statements. ) 

As each template is applied in turn, 
the colored markings that appear 
through the holes are each valued at 
Y% point, and added to the total of the 
penciled markings (1 point value) to 
make up the specific scale’s raw score. 


DISCUSSION 


The Cannot Say or ? category in per- 
sonality inventories plays an important 
role in psychometry. For one thing, it 
does serve as a container for those items 
which the client considers do not pertain 
to him.. But in addition, it provides a 
protective cage, so to speak, where the 
examinee can retire at will when he feels 
threatened. Unless a personality test in- 
cludes such a “protective” device, the 
antagonism of a client toward the rigidity 
of the True-or-False system of choice 
may result in his refusal to cooperate in 
the examination. To a more compliant 
subject, the situation may prove most 
distressful, and continuing working on 
the Inventory to the completion of the 
550 items could well prove harmful to 
him. Particularly is this true of neuro- 
psychiatric patients. 

It is apparent that the —? cards placed 
by one subject in the Cannot Say section 
may fully pertain to him, and those simi- 
larly rejected by another may not. But 
it is evident that many complications 
would result were each client to be evalu- 
ated accordingly on an individual basis. 
In order to continue the objectivity and 
relative simplicity of the MMPI scoring 
method, it would be generally feasible to 
regard all —? cards set aside in the Can- 
not Say category to be pertinent to the 
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examinee. In other words, a card with 
the special —? marking is just an ordi- 
nary card as long as it is sorted as true 
or false. Once it is put in the Cannot Say 
compartment, however, it assumes a —? 
value, i.e., considered as justifiably placed 
there by the patient because it does not 
pertain to him or he doesn’t know about 
it. 

To indiscriminately consider the Ques- 
tion score in relation to personality fac- 
tors would therefore be an error. Sup- 
pose a correlation is actually found be- 
tween the size of the Question score and 
personality, perhaps psychasthenia or de- 
pression. Patient A puts 60 cards in the 
Cannot Say division. Half of those are 
warranted, as they have —-? value. Pa- 
tient B also defers 60 items, but none are 
classified as —?. Patient A’s Question 
score could hardly be regarded in the 
same light as that of B’s. 

This brings up another aspect of the 
problem. After all the items are sorted 
by the patient, the authors of the MMPI 
suggest that the Cannot Say section be 
inspected, and “If more than about one 
tenth of the cards have been put in the 
Cannot Say category, the subject should 
be encouraged to place more in the other 
categories.”” But what if most, or even 
some, of the items are —? cards and are 
therefore validly isolated? Our “en- 
couragement” leads the examinee to give 
spurious value to those statements by his 
replacing them into the True and False 
groups. The discriminate client may be 
puzzled to first be told that he place cards 
that don’t pertain to him in the Cannot 
Say partition, and when he really does so 
with the —? cards, is urged to reverse 
himself and declare them and his other 
Question cards as true or false. This 
wholesale clearance of the Question sec- 
tion has been accepted as a virtue, for it 
has brought that many more items into the 
scoring fold. From the frame of refer- 
ence of this paper, certain (—?) items 
may validly be segregated in the Cannot 
Say section. 

From this discussion, it would appear 
that the initial instructions to the exami- 
nee would be given different emphasis: 
He would be instructed that certain state- 
ments may not apply to him at this time, 
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and others he may not know about. These 
he may place in the Cannot Say division. 
But the remainder more or less do apply 
to all persons, and those he should try to 
place in the True or False sections. 

When the client is through with the 
sorting, no matter how many cards are 
segregated as Cannot Say, he is not re- 
quested to resolve them. The examiner 
simply removes the —? items from this 
stack, and records the remainder as de- 
scribed. The size of the original Ques- 
tion score would then have no bearing on 
the validity of the test as a whole. 

It is believed that this practice, when 
standardized, will add to the delineating 
value of the MMPI’s validating, correc- 
tive and clinical scales. 


SUMMARY 


1. As many as 100 MMPI statements 
may be eliminated from scoring when 
placed in the Cannot Say category by the 
client. This tends to constrict the ratings 
of the various scales. 

2. The circumstances. under which 
cards are put in the Cannot Say section 
are discussed briefly. 

3. Certain Inventory items may validly 
be sorted in the Cannot Say division, and 
when thus classified, the examinee should 
not be urged to resolve them as true or 


false. These items are given “—?” sig- 
nificance. 

4. All other Cannot Say cards should 
be returned to the scoring system because 
they more or less apply to all persons. 
Such statements are assigned “+?” 
value. 

5. It is pointed out that a card isolated 
in the Cannot Say group, which can be 
answered true or false (all +? cards), is 
actually a falsification. This particularly 
limits the function of the Lie score. 

6. There remains the final selection of 
statements having —? significance, and 
experimental investigation to determine 
whether the return of the + ? cards to the 
scoring scheme will improve the diagnos- 
tic value of the MMPI. 
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THE USE OF Z SCORES IN EQUATING THE WECHSLER- 
BELLEVUE SUBTESTS* 


IRVING BARNETT 


State University of Iowa 


INTRODUCTION 


The importance of evaluating the sub- 
tests of an intelligence examination in 
addition to the mere reporting of an I.Q. 


* The writer acknowledges with gratitude the 
suggestions offered by the following at various 
stages in the preparation of this paper: Drs. 
George Copple, Kate L. Kogan, Saul Rosen- 
zweig, Carroll Whitmer, Erma T. Wheeler, and 
Mr. M. V. Taylor, Jr. Most of this paper was 
written while the author was a member of the 
hospital staff of the Mayview State Hospital, 
Mayview, Pa. 


is recognized by most clinicians. The 
Wechsler-Bellevue Intelligence Scale at- 
tempts to equate the scoring for all sub- 
tests by means of weighted scores in order 
that a direct comparison of the subject’s 
performance on the various subtests can 
be made. Thus, Wechsler“: ?- 148) states : 

“The second clinically useful feature of the 
Bellevue Scale is that the different abilities 
tested by it may be compared at all levels of 
functioning. This is achieved through the fact 
that the same type of material is used through- 
out the scale, and because the individual sub- 
tests of the scale have been equated.” 
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Unfortunately, this method fails to take 
into consideration the variations among 
the means of the subtests in the standard- 
ization group at various age levels and 
assumes that a given weighted score rep- 
resents the same level of ability on every 
subtest. This fallacy is exceptionally 
clear in the extreme age groups where 
there are large differences in the means 
and standard deviations of the tests. In 
the 55-59 age group the mean weighted 
score for Information is 9.5 while it is only 
5.9 for the Digit Symbol “: ®- 222), Should 
a subject obtain approximately the above 
weighted scores on the subtests, the com- 
parison might falsely indicate an impair- 
ment on Digit Symbol. In addition, the 
difference in standard deviation, amount- 
ing to 1.33 between Arithmetic and Digit 
Symbol is also not negligible. Likewise, 
at the 17-19 age level the mean for Digit 
Symbol is 11.1, while that for Arithmetic 
is 8.5. These inadequacies of the Wechs- 
ler-Bellevue provide grounds to challenge 
the accuracy of Wechsler’s “diagnostic 
signs” and Rapaport’s®? elaborate diag- 
nostic studies, together with the many 
others that have appeared in the literature. 

Foster) has re-weighted the means of 
the subtest scores as a solution to this 
question. In his discussion he indicates 
that individuals doing research with the 
present scoring might overcome this de- 
fect by utilizing groups of similar age in 
their studies. However, it should be 
pointed out that this method would per- 
mit comparisons of a given subtest among 
these subjects, but it would not allow for 
comparisons among subtests. Since the 
technique of “pattern analysis” involves 
the latter, a new method for analyzing the 
test results is unquestionably desirable. 


Tue Z ScorrE METHOD 


As a refined technique of equating the 


tests, we have constructed a series of 
tables (available from the author) with 
standard (Z) in place of the 
weighted scores obtained on the subtests. 
The calculations were made by algebra- 
ically subtracting a given weighted score 
from the mean of that subtest at the par- 
ticular age level. This amount was then 
divided by the standard deviation. This 
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method makes it possible to compare all 
subtests witu each other at any age level. 

The tables are arranged so that the cli- 
nician can ascertain, at a glance, the cor- 
responding Z score for a weighted score 
ranging from 0 to 18. Separate tables are 
provided for all age groups, 17 to 59. The 
data used in these calculations were ob- 
tained from the appendix of Wechsler’s 
manual. Unfortunately the mean and 
standard deviation for the Vocabulary 
subtest are not listed. In a personal com- 
munication with Wechsler, the writer was 
informed that “the original data are not 
available at present.” The tables. there- 
fore do not include Vocabulary, but the Z 
scores can easily be added when “norms” 
become available. Since all data presented 
here are from Form I, additional tables 
would be required for Form IT. 

Through the use of the method de- 
scribed above, diagnostic “signs” and 
“ratios” could assume a greater validity. 
A re-examination of past research may 
produce changes in present diagnostic 
“formulae.” 

A psychograph is provided on the re- 
vised record form for use with the Wechs- 
ler-Bellevue®, but Wechsler cautions 
about its “unreliability.” In using Z scores 
a psychograph can be drawn by plotting 
the standard scores as shown in the sample 
reproduced and described below in fig. 1. 
The horizontal line at sero is the “norm” 
or “assumed mean”’ for all subtests. Stand- 
ard score deviations from the mean of an 
individual's Z scores are marked off above 
or below the line to represent scores in the 
same relation to the subtest “norm.” This 
method affords a comparison of the indi- 
vidual’s scores with others of his own age 
group, and graphically presents what is 
really desired in an intelligence test. 

Wechsler“: »- 14% states that within the 
range of total scores from 80 to 110 a mean 
deviation of more than two points is sig- 
nificant, since, “This represents a devi- 
ation of approximately + 1 S.D. from the 
mean of 95 at ages 20 to 35.” Significant 
differences for scores not included in these 
limits are obtained by dividing the mean 
subtest score by four. The writer believes 
that when the analysis of scores is used 
for individual diagnostic purposes, it is 
preferable to spend the added time re- 
quired to calculate a standard deviation. 
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Accordingly, to simplify the procedure, a 
form consisting of columns and headings 
indicating each mathematical step in- 
volved in the computation is combined 
with the psychograph. 

In order to fill in the data it is neces- 
sary to keep the graph sideways, as this 
makes possible a compact use of the form. 
The usual statistical steps follow: (a) 





Illustrative Wechsler-Bellevue Psychograph. 


The weighted scores are first inserted for 
each of the subtests. (b) These are then 
converted into Z scores by means of the 
tables provided, and also entered and 
joined on the graph itself. (c) The alge- 
braic sum of the Z column is then calcu- 
lated and divided by ten to obtain the 
mean. (d) The standard deviation is de- 
rived as follows: Find the deviation of the 
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Z scores from the mean; square each de- 
viation’ ; calculate the total of the squares ; 
divide by ten; obtain the square root. (e) 
The expected range for the individual's 
scores is found by adding the standard de- 
viation to the mean for the upper range 
and subtracting it from the mean for the 
lower range. These points are entered on 
the graph by marking off horizontal lines 
in the appropriate positions. 

A glance at the graph reveals that al- 
though four tests have a weighted score 
of four, their Z scores indicate a scatter. 
The four subtests with weighted scores of 
eight also vary, but to a lesser degree. 
However, Comprehension and Digit Sym- 
bol are now on the same level in spite of 
the two points of difference between their 
weighted scores. 


DraGnostic IMPLICATIONS 


The comparison of profiles*in table 1, 
constructed through the use of weighted 
and Z scores, illustrates some of the de- 
fects which are inherent in the present 
method for scatter analysis. 


Tas_e 1. IJilustrative analysis comparing 

weighted scores and Z scores for a sample case. 

C.A. 56-0 Verbal 1.Q. 89 Perf. LQ. 91 Full 
scale 1.Q. 86 Diagnosis: Schizophrenia 


Subtests 


W ated. Scores Z scores 


Inf. 
Comp. 
Digits 
Arith. 
Simil. 
P.A. 
PG. 
B.D. 
O.A. 
D.Sym. 
Mean 


— .6 


1.0 
? 


nkbuinwstLONAN 


76 
37 


S.D. 





Organic Involvement. We might examine 
this profile for the possible presence of or- 
ganic involvement : 


According to Allen“, Information, Com- 
prehension, and Vocabulary are most re- 
sistant in a brain diseased person, and 
he states that either of these may be used 
as a point of orientation for scatter analy- 

1. Tables of squares are provided in most 


statistics books and can simplify the work in 
volved here. 
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sis. If weighted scores are applied here, 
both Information and Digit Span appear 
together at about two weighted points 
above the mean, which Wechsler considers 
the “normal range.” All other subtests, 
save Digit Span, fall below Information 
which may be considered as a “base” in 
this analysis. When Z scores are used, 
however, Information drops to a position 
about midway between the mean and + 1 
standard deviation. It is now below the 
Z scores of Arithmetic and Block Design, 
in addition to Digit Span, and only 
slightly above Digit Symbol. Comprehen- 
sion, which appears above the mean on 
Wechsler’s profile has also now fallen con- 
siderably. 

The diagnostic implications of the above 
are apparent. The vulnerability of In- 
formation and Comprehension in the new 
profile is on less stable ground. Allen's“ 
prediction that Digit Symbol and Block 
Design will show impairments in organic 
brain disease is confirmed according to the 
weighted scores, yet contradicted when 
the same subtests are represented by Z 
scores. These same items are now above 
the mean, or more important, not sig- 
nificantly below Information or Compre- 
hension. Object Assembly, which is also 
classed as a “susceptible” test item, is at 
the mean on the older profile but much 
lower on the revised form. 

Schizophrenia. When the same profile 
is analyzed with respect to schizophren- 
ic indicators as developed by Wechs- 
ler“, Pp 150, the Z scores again help to 
highlight positive factors, as shown be- 
low: 

“Sum of Pict. Arrangement plus Com- 
prehension should be less than Informa- 
tion and Block Design.” When the cor- 
responding values are calculated on the 
basis of Wechsler’s weighted scores, the 
formula becomes 4 + 6 (10) as against 
7 + 5 (12), or a ratio of .83. The alter- 
native figures are —.9 + —1.0 (—1.9) 
over —.6 + —.5 (—1.1) and a .58 ratio.’ 
Wechsler’s expectation that Picture Ar- 
rangement and Comprehension would be 
less is more strongly substantiated. 

“Object Assembly much below Block 
Design.”” Both weighted scores are 5 but 

2. Since the better scores are indicated by 
lower minus values, the ratio for Z scores is 
calculated by inverting the sums. 
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the Z equivalents become —1.0 and —.5 
respectively, and indicate a positive sign 
not apparent otherwise. 

“Very low Similarities with high Vo- 
cab. and Inf. definitely pathognomic.” 
Since Z for Vocabulary is not available, 
we are limited to a comparison of Simi- 
larities with Information. Scores here are 
4/7 with a .57 ratio, while Z values are 
—1.2/—.6 or a ratio of .50.° Here again 
the latter is more in the positive direction. 


DIscUSSION 


It is amazing that the Wechsler-Belle- 
vue has achieved such wide popularity and 
has been subjected to such intensive study 
for its diagnostic implications in spite of 
the limited population on which it was 
standardized. Furthermore, the so-called 
“weighted scores” have been utilized for 
clinical work and research in a manner 
that disregarded their statistical nature. 

The method of equating subtest scores 
described here does not solve the basic 
need for broader norms, but it attempts 
to solve one of its failures. It is recog- 
nized that a refinement such as this may 
not be justified in view of the above; yet 
if it is to be utilized clinically in its present 
form, we may as well make the best of it. 


PEIZOTTO 


‘hen a better standardization is com- 
WI! bett tandardizati on 
pleted, the techniques described in this 
paper should become still more useful. 


SUMMARY 


Although the Wechsler-Bellevue Intel- 
ligence Scale weights its subtest scores to 
facilitate comparing an individual’s per- 
formances, actually the scores are not 
equated with statistical accuracy. A meth- 
od of correcting this fallacy through the 
use of Z scores is suggested and a psy- 
chograph using this revision is described. 
Since previous research on diagnostic as- 
pects of the test overlooked these statis- 
tical errors, a re-examination of the accu- 
mulated data is proposed. 
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WECHSLER-BELLEVUE SUB-TEST 


PATTERNS: A NOTE 


OF CAUTION 


HELEN E. PEIXOTTO 


Catholic University of America* 


INTRODUCTION 


At the present time there is consider- 
able interest in the use of the sub-test 
patterns on the Wechsler-Bellevue Scale 
of Adult Intelligence for purposes of dif- 
ferentiating the normal, feebleminded and 
mentally ill. Attempts at such analysis 
are not new, but have also been tried with 
the Stanford-Binet’ ©. Certain previ- 
ous studies with the Wechsler-Bellevue 
have attempted to differentiate specific 

* This study was completed and written while 
the author was at the University of Hawaii. 


psychiatric groups but with little suc- 
cess!» * 4). Wechsler has published pat- 
terns for feebleminded, psychopathic, or- 
ganic brain damage, schizophrenia and the 
like. Rapaport’s study attempts to dif- 
ferentiate among the different types of 
psychoses and psychoneuroses. His 
sampling of subjects is, however, not as 
adequate as Wechsler’s as it is very 
highly selected. Wechsler’s subjects are 
selected in terms of locale. This criti- 
cism appears to be more important with 
regard to some sub-tests than others, 
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more important for some cultural groups 
than others. According to Wechsler“), 
feebleminded and psychopaths should 
have Performance Scores higher than 
Verbal, all other psychiatric syndromes 
should have Verbal Scores higher than 
Performance Scores. Rapaport“) does 
not report such gross differences, but his 
diagnostic charts indicate that on the 
whole Verbal Scores would be higher 
than Performance Scores. 


MetTHOD 


This investigation is a survey of 155 
unselected referrals to the Psychological 
and Psychopathic Clinic of the Univer- 
sity of Hawaii to determine to what ex- 
tent they would conform to the diagnostic 
patterns in use. These cases include both 
males and females. The age range is 
from about 14 to 50 years of age. The 
sources of referral are mainly from the 
Juvenile Court and Adult Probation De- 
partment. The original tabulations dif- 


ferentiated among the various national 
groups, but it was found that there were 
too few in each group to make such analy- 


sis meaningful. However, it might be 
interesting to mention the national make 
up of the group; there were Hawaiian, 
Chinese, Japanese, Korean, Caucasian, 
Portuguese, Filipino, Puerto-Rican, Ha- 
waiian-Oriental, Hawatian-Caucasian and 
miscellaneous combinations. The cases 
were divided into two groups, those whose 
Verbal Scores were higher than the Per- 
formances Scores and vice versa. Tabu- 
lation was done according to a five point 
scale of differences in the two scores. The 
number of mental defectives falling in 
each grouping was tabulated. There were 
too few cases in each group to make per- 
centages statistically permissible. There 
were only sixteen cases on which psychiat- 
ric evaluation was available and these in- 
cluded several different types of disorders 
so only a brief qualitative statement will 
be made with regard to them. 
RESULTS 

The statistical breakdown of those 
cases whose Verbal Score was_ higher 
than the Performance Score indicate 
there are thirty-four or 22% such cases. 
For those whose Performance Score was 
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higher than the Verbal Score there are a 
hundred and twenty-one or 789. There 
are twenty mental defectives in the whole 
group of a hundred and fifty-five cases, 
50% having Verbal Scores higher than 
Performance Scores and 50% Perform- 
ance Scores higher than the Verbal. Thus 
of the first group mentioned, 29% are 
mentally defective while of the second 
only 8% are defective. Obviously, these 
per cent values are the opposite of what 
one has been led to expect. As a matter 
of fact, only 15% of the mentally de- 
fective cases show the expected deviation 
on the two scales, that is only 15% show 
a difference of eleven points or more in 
favor of the Performance Scores. 

The results concerning psychiatric syn- 
dromes are only suggestive because there 
are only sixteen cases covering varied 
diagnoses as previously mentioned. These 
diagnoses were psychoneurosis, schizo- 
phrenia, psychopathic personality, and or- 
ganic brain damage. According to Wechs- 
ler, psychopathic personalities should ob- 
tain higher Performance than Verbal 
Scores, the other psychiatric conditions 
should have higher Verbal Scores. It is 
sufficient to note that these sixteen cases 
do not conform to established test pat- 
terns, but are scattered throughout both 
distributions, i.e., Verbal Scores higher 
than Performance and Performance 
Scores higher than Verbal. The cases 
diagnosed as organic brain damage do 
have higher Verbal than Performance 
Scores, but none shows a significant de- 
viation. 

It seems apparent from the results of 
this investigation that the published sub- 
test patterns of the Wechsler-Bellevue 
Scale are not applicable to the clientele of 
the Psychological Clinic of the Territory 
of Hawaii. This is true for the patterns 
of both Wechsler and Rapaport). 
Rapaport bases his patterns on deviations 
from vocabulary scores. For the major- 
ity of the cases in this study the vocabu- 
lary score is frequently the lowest of the 
verbal scores, and even if one substitutes 
the total Verbal Score, it is obvious that 
such a procedure will have little value 
with our population. 

These results are particularly note- 
worthy with regard to the mentally defec- 
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tive, and it is important to the interpreta- 
tion of these facts that the psychologists 
of the Psychological Clinic are extremely 
conservative in respect to diagnosing in- 
dividuals as defective. Thus, even if an 
individual scores low on testing but is 
making a satisfactory social adjustment, 
i.e., if there are no complaints from fam- 
ily, neighbors, social or law enforcing 
agencies, such a person is not deemed to 
be feebleminded or subject to institu- 
tionalization. 

The results suggest the same inapplica- 
bility with regard to psychiatric syn- 
dromes. Perhaps the outstanding char- 
acteristic of our population as compared 
with similar populations is bilingualism, 
even if the second language is only “pid- 
gin.” It is believed, then, that consider- 
able caution must be exercised in applying 
these test patterns to the population sam- 
pled by these data, and perhaps, to any 
bilingual population or individuals. 


SUMMARY 


1. This investigation is a survey of 155 
cases in the Territory of Hawaii to de- 
termine the validity of the Wechsler- 
Bellevue diagnostic patterns for various 
clinical entities such as feeblemindedness 
and psychiatric syndromes. 

2. The results indicate that these pat- 
terns are not valid for the population 
studied. The results are most significant 
as regards feeblemindedness. More than 
three-fourths of the cases cited have Per- 
formance Scores higher than Verbal and 
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only 15% of the feebleminded show the 
expected deviation in scores. There is a 
suggestion that feebleminded are about 
equally inferior in verbal and perform- 
ance tests. A strong tendency of similar 
inapplicability is evident for psychiatric 
diagnoses. 

3. Therefore caution must be exer- 
cised in depending on published patterns 
for any type of diagnosis. This does not 
reflect on the usefulness of the Wechsler- 
Sellevue Scale as a test of general intelli- 
gence. 
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THE EFFECT OF LATERALITY LOCALIZATION OF BRAIN 
DAMAGE ON WECHSLER-BELLEVUE INDICES 
OF DETERIORATION’ 


A. LLOYD ANDERSEN 


Minneapolis Veterans Administration Hospital 


INTRODUCTION 


In the course of routine examination of 
patients on the neurology wards of the 
Minneapolis Veterans Hospital it was ob- 
served that the indices of deterioration 
used in connection with the Wechsler- 
Bellevue Intelligence Scale“) often com- 
pletely failed to identify definitely estab- 
lished cases of focal brain damage. (The 
term focal brain damage, as used here in- 
dicates damage of a relatively confined 
cerebral area as opposed to generalized 
brain damage, defined as damage involv- 
ing most or all of the cerebrum. Gen- 
eralized brain damage is secondary to 
conditions such as toxic or infectious 
encephalitis, whereas focal brain damage 
is commonly secondary to brain tumor, 
gunshot wound or similar trauma.) This 


condition appeared to be related to the 
laterality localization of the focal injury 


to the cerebrum. The present paper re- 
ports an investigation of this relationship 
together with an investigation of the gen- 
eral efficacy of two Wechsler-Bellevue 
indices of deterioration among cases of 
definitely established brain damage. 

The two indices of deterioration ex- 
amined in this study are the Wechsler- 
Bellevue Deterioration Quotient and the 
Reynell Index. The Deterioration Quo- 
tient (hereafter DQ) is in wide general 
use and is adequately defined by Wech- 
sler(® PP. 65°67). Therefore, no further de- 
scription «will be given here. 

The Reynell Index (hereafter RI) was 
described in a publication by Reynell 
in 1944. It makes use of the Verbal sub- 
tests only. RI is calculated by deriving 
Verbal 1Q’s from each of two groups of 

1. The material contained in this paper is 
abstracted from a Ph.D. thesis presented to the 
University of Minnesota Department of Psy- 
chology. The paper is published with the per- 
mission of the Chief Medical Director, Depart- 
ment of Medicine and Surgery, Veterans Ad- 
ministration who assumes no responsibility for 


the opinions expressed nor the conclusions 
drawn by the author. 


three Verbal subtests. The deterioration- 


sensitive group is composed of the Digit 


Span, Arithmetic, and Similarities sub- 
tests. The remaining three Verbal sub- 
tests make up the group considered rela- 
tively insensitive to deterioration. The 
weighted score sums for these two groups 
are multiplied by 5/3, since the Wechsler 
tables of Verbal IQ’s are based on sums 
of five subtest weighted scores. The dif- 
ference between the two IQ’s thus de- 
rived is the Reynell Index, the deteriora- 
tion-sensitive IQ being subtracted from 
the non-sensitive IQ. A difference of 
plus ten or more is considered indicative 
of significant loss. The RI was developed 
and evaluated in England in terms of 
predicting success in rehabilitating pa- 
tients who suffered head injuries during 
the last war. 

The subjects used in this study were 
fifty-five male veterans of World Wars 
I and IJ. All were seen as either in- 
patients or outpatients at the Minneapolis 
Veterans Hospital. The age of the pa- 
tients ranged from nineteen to sixty-one 
years ; the mean age was 32.47 years and 
the median age 26.77 years. Comparison 
with population statistics indicated that 
the education of the group was superior 
to that of the general population; the 
median years of school completed for the 
forty patients aged twenty-five years and 
over was 11.61; the comparable median 
for this age group in the general popula- 
tion is 8.7 years Pp. 125-126), There were 
no statistically significant differences be- 
tween the occupational classification of 
the group and that for the general popu- 
lation: P- 199), 

All patients used in the study had suf- 
fered focal cerebral brain damage con- 
fined ‘~ one cerebral hemisphere, as far 
as could be determined. All cases were 
either surgically substantiated as brain 
damaged or, in the case of a few gunshot 
wounds, established by X-ray evidence of 
retained metallic foreign bodies within 
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the brain substance. The presence of 
definite injury to the cerebrum was estab- 
lished beyond any reasonable doubt in 
every patient included in the study in con- 
sultation with members of the neurologi- 
cal and neurosurgical staff. However, 
the criterion of unilaterality is probably 
relatively poor. Such conditions as un- 
reported previous trauma, possible con- 
trecoup injury and even the possibility of 
surgical misdiagnosis may have contrib- 
uted to the fallibility of proper laterality 
localization. Studies employing perfect 
localization criteria will probably have to 
await the collection of cases with avail- 
able post-mortem examinations. 

The total sample of fifty-five cases was 
also treated in two subgroups. <A sub- 
group of thirty cases of non-dominant or 
recessive cerebral hemisphere injury and 
a subgroup of twenty-five cases of domi- 
nant hemisphere injury were employed. 
As used in this study the terms dominant 
and non-dominant, or recessive, refer 
only to the cerebral hemisphere contra- 
lateral to the preferred hand and _ipsi- 
lateral to the preferred hand, respectively. 
Hand preference was determined by ob- 
servation and interview for each case. 

Only one statistically significant dif- 
ference appeared between these two sub- 
groups with regard to the statistics re- 
ported above for the total sample. The 
non-dominant hemisphere subgroup 
(hereafter the NDH subgroup) was sig- 
nificantly older (P< .01) than the domi- 
nant hemisphere subgroup (hereafter the 
DH subgroup). Probably the best hy- 
pothesis to account for this difference is 
that a dominant hemisphere injury is 
more liable to result in permanent apha- 
sias in the older age group where some 
degree of normal senescent loss has al- 
ready occurred. Also younger men tend 
to be more responsive to retraining after 
developing severe aphasic disabilities. 
Either of these conditions would operate 
as a selective factor to produce the ob- 
served age difference, since all patients in- 
cluded in the sample were capable of 
communication and cooperation. If the 
older dominant hemisphere patients were 
relatively more disabled and, consequent- 
ly, less testable, their inclusion in the 
sample would be relatively rare. 


ANDERSEN 


PROCEDURE 


Form II of the Wechsler-Bellevue In- 
telligence Scale’) was administered to 
the patients by psychologists experienced 
in the use of the test. After the cases 
were collected all tests were checked for 
accuracy of addition and, in the case of 
the more subjectively scored subtests, for 
consistency of scoring. 

The Wechsler DQ was calculated by 
the usual method for each case. The me- 
dians, ranges, means and standard de- 
viations of the DQ distributions for the 
total sample, the NDH subgroup and the 
DH subgroup were obtained. Wechsler 
(6, pp. 65-67) states that a “‘per cent” loss 
of ten (DQ of 90) indicates possible de- 
terioration, while a “per cent” loss of 
twenty (DQ of 80) indicates definite de- 
terioration. Accordingly, the percentages 
of cases falling below these two values in 
the total sample and its two subgroups 
were calculated. 

The same statistics were obtained for 
the distributions of the Reynell Index for 
these groups. The percentages of cases 
falling below the cutting score of plus ten 
IQ points difference suggested by Rey- 
nell) were calculated. 

Pearson correlation coefficients be- 
tween the two indices and between each 
index and age within the total sample 
and the two subgroups were calculated. 


RESULTS AND DISCUSSION 


Tables 1 and 2 give the results of the 
application of the Wechsler DQ in the 
total sample and the NDH and DH sub- 


groups. In terms of the means and me- 
dians shown in Table 1, all three distribu- 
tions tend to be negatively skewed, the 
tendency being stronger in the DH sub- 
group. Both the mean and standard de- 
viation of the DH subgroup are lower 
than the comparable statistics for the 
NDH subgroup. These differences, how- 
ever, do not reach statistical significance. 
Apparently, the possibility that these 
sample differences are due to an associa- 
tion with the age variable, which showed 
similar trends, must be rejected: the 
Pearson r of the DQ with age in the 
total sample is —.12, in the DH sub- 
group —.11, and in the NDH subgroup 
-.06. 





LATERALITY LOCALIZATION 


Taste 1. Results of the application of the Wechsler DQ to the total sample of 


focally brain damaged patients 








Sample Median Range 


Mean pep 2B 





Total sample 84.25 36-122 


83.20 16.30 


NDH subgroup 
DH_ subgroup 


86.50 
82.00 


36-122 
38-95 


85.53 
80.40 


16.46 
15.64 





Table 2 gives the results achieved by 
applying the two cutting scores suggested 
by Wechsler to the present sample of au- 
thenticated cases of focal brain damage. 
Nearly a third of the total sample show 


Tasie 2. Percentages of focally brain damaged 
patients not identified at the two cutting scores 
suggested by Wechsler for the 


Wechsler DQ 








Per cent loss (cut) 


Sample “Over 10 Over 20 





32.73 
40.00 
24.00 


65.45 
73.32 
56.0€ 


Total sample ... 
NDH subgroup. 
DH subgroup .. 





less than the ten “per cent’ loss indicative 
of “possible” deterioration, while nearly 
two thirds of the cases fall below the cut- 
ting score of twenty designated as indica- 
tive of “definite” deterioration by Wech- 
sler. 


TABLE 3. 





the mean of the quotients is equal to the 
quotient of the means made in the der- 
ivation of the DQ: P- 65), 

The DQ also shows a differential effec- 
tiveness in the NDH and DH subgroups 
with the use of these cutting scores, being 
more effective in the DH subgroup. This 
difference in effectiveness is statistically 
significant (P < .025) when tested by the 
chi-square test of frequency discordance. 
Tables 3 and 4 show the statistics for 
the Reynell Index. The distributions 
show even more of a tendency to negative 
skewness than was true of the DQ distri- 
butions; once more’ the skewness is 
stronger in the DH subgroup. In con- 
trast to the DQ statistics, it is the DH 
subgroup which shows the higher mean 
and standard deviation and the least loss 
of cases at the ten-point cutting score 
suggested by Reynell. The laterality sub- 
group differences are not statistically sig- 


Results of the application of the Reynell index to the total sample 


of focally brain damaged 








Sample 


Median Range Mean 





Total sample 
NDH subgroup 
DH subgroup 


17.17 
14.00 
17.75 


—10-44 
—12-38 
—10-44 


14.56 
13.40 
15.96 





Wechsler does not indicate what pro- 
portion of normals may be expected to be 
misclassified as deteriorated by the DQ, 
nor has he indicated’ the means by which 
he derived the cutting scores he suggests. 
Since the DQ was derived on the basis 
of the means of the subtests, it is possible 
that the actual distribution of the quotient 
was not prepared. In any case, an esti- 
mate of the percentage of false positives 
to be expected, based on the statistics 
provided, would necessitate the assump- 
tion of normality in the quotient distribu- 
tion and of subtest equivalence between 
Forms I and II, as well as the use of the 
mathematically invalid assumption that 


nificant, however. This may be due to 
the fact that the RI was developed for 
use with cases of focal injury, whereas 
the DQ is based on the assumption that 
the intellectual changes accompanying 
normal senescent decline are similar to 


Tapsre 4. Percentages of focally brain damaged 
patients not identified at the cutting score sug- 
gested by Reynell for the Reynell index 





Cutting score 


Sample 10 points 





34.55 
36.67 
32.00 


Total sample 
NDH subgroup 
DH subgroup 














ee eee ee RL a 


194 A. LLOYD ANDERSEN 


those secondary to trauma »- 59). This 
may be true, but the adequate psycho- 
metric measurement of focal traumatic 
damage by the DQ may require that the 
changes be identical, or nearly so, rather 
than merely similar. 

The Pearson correlation of RI with 
age is not significant, being —.11 in the 
total sample, —.07 in the NDH subgroup, 
and —.08 in the DH subgroup. The RI 
shows moderate to high correlation with 
the Wechsler DQ. Within this sample of 
focally brain damaged patients, the corre- 
lation between the two indices is stronger 
in the DH subgroup (r = +.83) than in 
the NDH subgroup (r=+.65). The 
correlation in the total sample is r= 
+.74. 

There seems to be sufficient evidence to 
indicate that both the Wechsler DQ and 
the Reynell Index leave much to be de- 
sired as measures or indicators of focal 
brain damage. While the RI is less sen- 
sitive to laterality localization effects, it 
appears to have about the same overall 
effectiveness as DQ which shows far 
more differential effectiveness in identify- 


ing DH and NDH brain damage. 
Judging from the present findings, the 
“twenty-per cent loss” cutting score for 
the DQ is unquestionably too high, since 
approximately two-thirds of authenticated 
cases of focal brain damage fall below 


this score in the sample studied. The re- 
sults reported here are consistent with 
those reported by Allen“: *? who has also 
found the DQ unsatisfactory for use 
with brain injured patients. Blake and 
McCarty“ recently compared a group 
of normals with Allen’s brain injured pa- 
tients. Though they were able to demon- 
strate a highly significant statistical dif- 


ferentiation, the separation appeared to 
be of questionable clinical value. 

Fairly consistent evidence appears in 
the present study to indicate that one fac- 
tor contributing to the poor clinical per- 
formance of present measures of deteri- 
oration is that localization effects may 
interfere with the measurements. This 
is true because present indices are based 
on the assumption that brain damage is a 
single unidimensional variable. It seems 
possible that a different approach to the 
problem of deterioration measurement 
would be profitable. If brain damage 
varies qualitatively according to the lo- 
calization of cerebral lesions, several area- 
specific indices may have to replace single 
overall deterioration measures. 
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THE APPLICATION OF THE WECHSLER-BELLEVUE SCALE 
IN THE DIAGNOSIS OF ORGANIC BRAIN DISORDERS 


BRIGETTE GUTMAN 
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INTRODUCTION 


This study is an evaluation of various 
ways of patterning Wechsler-Bellevue 
subtest scores in an attempt to find the 
method which most closely agrees with 
clinical findings and to see whether that 
method is sufficiently valid to warrant its 
use in a hospital situation. It is an at- 
tempt to evaluate the reliability of the evi- 
dence picked up by the use of an instru- 
ment not specifically designed for the 
study of brain damage. Wechsler’s pat- 
terns) are familiar to all clinicians. 

Reynell™ in his formula for detecting 
organic brain damage uses only the verbal 
section of the Wechsler-Bellevue scale. 
He takes the weighted scores for the {n- 
formation, Comprehension, and Vocabu- 
lary tests and gets an equivalent verbal 
score by multiplying the sum by 5/3 and 
finding in Wechsler’s tables the patient’s 
verbal Intelligence Quotient. A _ similar 
procedure is applied to the sum of the 
Similarities, Arithmetic, and Digit Span 
tests. If the quotient of the latter, the 
“Don’t hold” tests, is ten points or more 
below that obtained on the “Hold” tests, 


TABLE 1. 


a diagnosis of Organic Brain Damage is 
made. 

Hewson“) worked out a pattern of de- 
viation ratios for diagnosing organic brain 
damage. In this procedure the weighted 
scores of the Wechsler-Bellevue scale are 
used in different combinations to make up 
eight ratios for each set of scores. If a 
ratio is above a certain point specified by 
the author, that particular item is termed 
“organic”; if it is below that point the 
classification is “normal.”’ (Hewson also 
has a “neurotic” category which was not 
included in this study. According to her 
ratios neurotics score low where organics 
score high and vice versa, so that the 
omission of this category in no way in- 
fluences the results obtained here. ) 

Table 1 gives the eight ratios and the 
point above (or below) which each ratio 
is termed organic. 

Certain configurations of organic and 
normal individual scores give a diagnosis 
of “organic” as described by the author. 
These configurations were worked out by 
her from known diagnoses on a group of 
patients. According to her ratios, when 


Hewson’s deviation ratios 








Ratio 





I. Picture Arrangement + Picture Completion 





Arithmetic + Digit Symbol 
II. Information + Comprehension 


Arithmetic 


III. Information + Comprehension 
Digit + Digit Symbol 
IV. Information + Comprehension 





Above 


Above 





Picture Arrangement + Digit Symbol 


V. Information + Comprehension 


Digit Symbol 


VI. Information + Comprehension 





Digit Repet. + Picture Arrange. — Digit Symbol 


VIL. Digit Repetition + Digit Symbol 


Similarities + Block Designs 





VIII. Comprehension + Picture Arrangement 





Digit Symbol 
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Ratio | is organic and the Digit Symbol 
score is below the subject’s own average 
weighted score, the record is an organic 
one; the record is also termed organic 
when any other ratio from I through 
VIII is organic, unless the only organic 
one is on Ratio IT. 


PROCEDURE 


In the present study the Wechsler-Bel- 
levue test results of thirty patients diag- 
nosed clinically as organic brain damage 
were analyzed according to the methods 
given by Wechsler, Reynell and Hewson 
and which were described in the forego- 
ing. In this way an evaluation of these 
diagnostic patterns was to be obtained. 
The subjects were selected at random 
from the organic file of the Neurological 
Institute of Presbyterian Hospital in 
New York City. The first thirty cases 
who had been seen by the Psychology De- 
partment were used; seventeen of these 
cases were tested by the author. Only 
cases with known organic damage were 
selected. Patients with a history of con- 
cussion were not included in the group. 

All subjects had been patients of the 
Neurological Institute of New York and 
had had all possible clinical tests includ- 
ing electroencephalogram and pneumo- 
encephalogram to ascertain the diagnosis. 
Although the possibility of a wrong diag- 
nosis has not been eliminated, it has been 
reduced to a minimum by various clinical 
procedures. Five of the patients were 
diagnosed clinically as convulsive dis- 
order, grand mal type, with some asso- 
ciated deterioration of brain tissue; four 
were C. N.S. Luetics; thirteen had brain 
tumors (cerebral) which were subse- 
quently operated ; three had an encephalo- 
pathy due to poisoning; and five had a 
congenital brain anomaly. Eighteen of 
the patients were males, twelve females. 
The mean age of the group was 29 years, 
10 months at the time of testing, and the 
range from 16 to 54 years. The average 
Intelligence Quotient for the group was 
93 with the range from 62 to 122. 


RESULTS 


Wechsler does not state how many of 
the indicators of each patient have to 
agree with those given in Measurement 


of Adult Intelligence in order to estab- 
lish brain damage. Consequently, this 
had to be done by the examiner; in the 
present study a record was termed or- 
ganic if six or more of the twelve signs 
agreed with those given by Wechsler. 
Half a count was given to those items 
where Wechsler indicated “~—-’ and the 
score obtained was ‘—” or vice versa, 
with the same procedure applied to the 
+ items. For items which were marked 
“_— to 0” by Wechsler, any of the three 
signs, —-, —, or QO were accepted. Sub- 
sequent analysis of data confirmed the 
assumption that this was a good point of 
division. As the margin between the per- 
centage of “organics” in the two groups, 
the one of known brain damage cases and 
the control group of persons with no 
known damage, was found to be so small 
when the method given by Wechsler was 
applied (as will be seer), adjustment of 
the number of signs which haél to agree 
could not make a difference large enough 
to make the result significant. 

According to this way of tabulating re- 
sults, thirteen of the thirty patients in 
this group were shown to have an or- 
ganic pattern and it can be said that in 
thirteen, or forty-three per cent of the 
thirty cases, correct diagnosis would have 
been made by the Wechsler method of 
patterning. Thus we see that the signs 
are of little significance from a clinical 
point of view; it would become appar- 
ent that they cannot be used for differ- 
ential diagnosis. 

Using Reynell’s method fifteen of the 
thirty patients are classified in the organic 
group making a correct diagnosis in fifty 
per cent of the cases which, though 
higher than that obtained by the Wechsler 
method, is still not valuable in actual diag- 
nosis. According to Hewson’s ratios 
eighteen patients, or sixty per cent of the 
cases, fell in the organic group. 

Table 2 shows the distribution of or- 
ganic diagnosis of the different patterns 
on the basis of the patient’s clinical diag- 
nosis. 

In examining this chart, no one method 
stands out markedly in being better or 
decidedly poorer than the other two 
methods for diagnosing a particular clas- 
sification; that is, whereas one method, 
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TABLE 2. 


Distribution of “organic” classification on the basis of the various patterns 








Classification 


x 


Organic Not organic 


R H W R H 





Grand Mal 

C. N. S. Lues 

Tumor bis 
Congenital and Birth Injury ... 
Toxic Encephalopathy 


| Mme Nh we 


— 
wn 





W = Wechsler. R = Reynell. 
that given by Hewson, gives a_ higher 
percentage of accurate diagnoses, it can- 
not be said that it is better in any one 
particular category, such as picking out 
brain tumor cases, but rather that the 
general picture seems to be somewhat bet- 
ter than it is on the other two methods. 


CONTROL Group 


A control group of thirty “normal” 
cases was patterned next according to the 
procedures described. This group was 
selected at random from the files of the 
New York University Testing and Ad- 
visement Center; all cases were those of 
clients who had come to the Center for 
vocational. guidance. They were used in 
an attempt to see the incidence of ‘‘or- 
ganic” diagnosis in a group of people who 
have shown no organic signs whatever, 
and in whom we have no reason to sus- 
pect organic brain damage. 

In this group there were twenty-two 
males and eight females; their ages 
ranged from 17 years, 8 months to 52 
years, 2 months, the median age being 25 
years, 4 months. The range of Wechsler- 
Bellevue quotients was from 101 to 133 
with the median 117. 

Relationship between Intelligence Quo- 
tient and agreement of findings with 
Clinical Diagnosis could not be estab- 
lished except for the fact confirmed in 
the literature by Allen™ that patients with 
brain damage tend to score consistently 
lower than those without such damage. 
It was not possible to find a relationship 
between age and correctness of diagnosis ; 
thus it is thought that the differences of 
age and Intelligence Quotients of the two 
groups used do not interfere with the di- 
rect comparison of results. 


H = Hewson. 


According to Wechsler’s method of 
patterning, ten, or thirty-three per cent 
of the thirty “normal” cases, fell into the 
organic group. Applying Reynell’s meth- 
od, nine cases, or thirty per cent, are 
termed organic; Hewson’s deviation ra- 
tios show five, or seventeen per cent such 
records. 

DiscUSSION 


The methods of diagnosing cerebral 
pathology devised by Wechsler, Reynell 
and Hewson showed the presence of such 
involvement in 42, 50 and 60 per cent 
respectively of a group of patients who 
were shown clinically to have an organic 
involvement of the brain. Since it is 
probable that cases with a doubtful clini- 
cal diagnosis who do have a cerebral 
pathology would not give a pattern as 
characteristic of this classification as do 
those whose diagnosis was clinically evi- 
dent, we may expect the percentage of 
valid diagnoses to be even lower in clini- 
cally doubtful cases. 

All three of the methods agree in their 
conclusions regarding the statement of 
whether or not the patient’s intellect has 
been affected by an organic disease of the 
brain in only ten cases (thirty-three per 
cent) of the total number of cases 
analyzed. When we consider that of 
these nine cases, five (17 per cent) of the 
total number, were considered “not or- 
ganic” by all three methods, the percent- 
age of correct diagnosis is even lower 
than would seem at first. It is felt that 
the possibility of a wrong clinical diag- 
nosis on any of these five cases may be 
eliminated as definite evidences of patho- 
logical lesions were found. 

Tabulating the results of the control 
group with those obtained on the group 
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of patients known to have an organic 
pathology (Table 3) makes possible a 
comparison and estimation of the actual 
margin of validity of the three proce- 
dures. 

Tas_e 3. Comparison by percentages of 
organic classification 








30 cases 
known to have 
a cerebral 
pathology 


30 cases with 
no evidence 


Method of such damage 





Wechsler 
Reynell 
Hewson 


43% 
50% 


0% 


33% 
30% 
17% 





We thus find that the chances of mak- 
ing a correct diagnosis on the basis of 
Wechsler’s patterns are .55, that is, that 
we will be correct 55 times in a hundred 
when applying this method of diagnosing 
organic brain disease. Chi square is .63, 
showing that these results might have 
been obtained by chance 5 times in ten, 
thus making no gain over pure guesswork. 

With Reynell’s method the chances of 
making a correct diagnosis are .60; Chi 
square is 2.5 with one chance in ten of 
obtaining for results by chance. The 
chances of making a correct diagnosis by 
the Hewson method are. .717; in seven 


out of ten cases who are “organic” ac- 


cording to Hewson’s method, clinical 
neurological examination confirmed this 
conclusion. Chi square for this method 
is 5.9, showing that there is less than two 
chances in a hundred of getting the re- 
sults by chance. From the foregoing it 
appears that the methods given by Wechs- 
ler and Reynell are ineffectual in differ- 
ential diagnosis. | Hewson’s deviation 
ratios, although they should not be taken 
by themselves as a means of differential 
diagnosis, do increase the chance correct 
diagnosis considerably. 
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SUMMARY 


This study is an attempt to evaluate 
three methods of using Wechsler-Belle- 
vue scores for differential diagnosis in 
cases of organic brain damage. The 
Wechsler-Bellevue scores of the experi- 
mental and clinical groups were analyzed 
according to methods given in the litera- 
ture by Wechsler, Reynell and Hewson 
in an attempt to find which of the meth- 
ods, if any, were feasible for use in dif- 
ferentiating between patients who have 
cerebral brain damage from those who do 
not. 

It was found that the only method 
feasible for actual clinical use is that de- 
veloped by Hewson which agreed with 
clinical diagnosis in 71 per cent of the 
cases used. From the results obtained in 
this study it would seem that the Hewson 
Deviation Ratios are sufficiently helpful 
in the diagnosis of organic brain damage 
to warrant their use together with other 
psychological tests and clinical procedures. 
It should be peinted out, however, that 
we cannot expect the method to be as 
helpful in clinically doubtful cases ; a dis- 
ease of the brain must bring about a suf- 
ficiently great change in personality be- 
fore it can be detected by psychological 
tests of intelligence or personality. 
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A COMPARATIVE EVALUATION OF THE WECHSLER-BELLEVUE 
MENTAL DETERIORATION INDEX FOR VARIOUS 
ADULT GROUPS*+ 


LAWRENCE S. ROGERS 


leterans Administration Mental Hygiene Unit, Denver, Colorado 


In recent articles the value of the 
Wechsler Mental Deterioration Index 
(MDI)¢ in screening patients with brain 
damage from normal patients has been 
considered. Allen“? has found that by 
using a loss of greater than 20%, he could 
definitely screen out only 54% of his 
study group of 50 patients. Blake and 
McCarthy“*? raised the question as to how 
many normal subjects would be misclassi- 
fied as showing impairment by the use of 
such an index. In their paper they were 


concerned solely ‘“‘with the problem of 
distinguishing qualitatively different pre- 
selected groups at the quantitative level 
by using this index, and not with its value 
as a technique for differential diagnoses.” 
However, they note that Allen implied the 
use of this index for differential diag- 


noses, as did Levi, et al.“ 

The purpose of this paper is to investi- 
gate the MDI further as a tool for dif- 
ferential diagnosis; that is, to determine 
whether a significant loss in this index is 
related solely to deterioration such as is 
found in subjects who have had organic 
brain injury or damage. Levi, et al.“ 
pointed out that “the index of deteriora- 
tion is useful not only in confirming, but 
also in discovering organic conditions.” 
However, Wechsler“! »- ©) points out 
that this index may also be applied in 
cases of schizophrenia, although he goes 
on to say that schizophrenics would tend 
to have lower scores on some of the 
“Hold” tests than on some of the “Don’t 
hold” tests. If this index can be consid- 
ered as a tool for distinguishing subjects 
with organic brain injury from all other 
categories of subjects, then in the other 

* Read at the meeting of the Rocky Mountain 
Branch of the American Psychological Associa- 
tion, at Laramie, Wyoming, May 13-14, 1949. 

¥ Published with the permission of the chief 
Medical Director, Department of Medicine & 
Surgery, Veterans Administration, who assumes 
no responsibility for the opinions expressed or 
conclusions drawn by the author. 

t All MDI’s are corrected for age. 


categories the MDI should be insignifi- 
cant. The continued use of the MDI in 
its present form gives pertinence to a 
study such as this. 


SUBJECTS 


This report is based on a total of 349 
subjects. They were all given the Wechs- 
ler-Bellevue Form I examination, and fall 
into seven distinct groups, four of which 
were previously reported in the literature. 
Mental deterioration indices have been re- 
ported on for two groups, and were com- 
puted by the author for the rest. Allen‘? 
reported on 50 brain injured patients, that 
is, patients who ‘had suffered actual pene- 
tration into the encephalon. Blake and 
McCarthy‘? compared normal subjects, 
a group of 50 college students, to Allen’s 
group. In this paper we have also used 
the normal control group as reported by 
Rapaport’? ; we used only the 49 men 
who fell into the well-adjusted group and 
border-line adjusted, and eliminated the 
five maladjusted - individuals. Kogan‘) 
reported test results of 50 patients who 
were clear-cut cases of schizophrenia at 
the time of test administration, and were 
in treatment at a mental hygiene clinic or 
in a neuropsychiatric hospital, and who 
also had a previous record of a diagnosis 
of schizophrenia. In addition to these 199 
subjects, three other groups of 50 each 
were added. Two groups were obtained 
from the files of a vocational counseling 
service which had a contract with the 
Veterans Administration. One of these, 
VCS non-neurotic, consisted of 50 men 
who were receiving compensation for 
some non-neuropsychiatric injury — in- 
curred in or aggravated by military serv- 
ice. These disabilities ranged from ma- 
laria to TB to gunshot wounds. The VCS 
neurotic group consisted of 50 men who 
were receiving compensation for neuro- 
psychiatric conditions. Both of the VCS 
groups were making application for voca- 
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Tas_e 1. Differences in MDI’s for the groups 








Mean Mean 
Subjects Age IO 


Less 20% or 
No loss than 10% 10-19% more 


N % ym °-3 





Allen 25.0 94.98 
Blake and McCarthy .. 28.3 124.80 
Rapaport 35.76 115.70 
VCS Non-Neurotic ... 27.92 101.11 
VCS Neurotic 28.12 105.12 
MHC Neurotic 28.20 110.01 
Kogan Schizophrenic . 25.38 105.00 


16 12 
40 36 
45 29 
34 

38 20 
22 - oo 
26 28 





tional training under Public Law 16 at 
the time the tests were administered dur- 
ing the calendar year of 1946. The groups 
were differentiated only on the basis of 
Veterans Administration diagnosis, not 
on the basis of current complaints or 
symptoms. It was noted at the time of 
testing that many of the complaints of 
the ‘‘non-neurotic” group seemed to be 
of psychogenic origin, and that as a group 
they appeared to be quite maladjusted. 
For the most part these men were re- 
cently discharged from service and were 
unemployed. The results reported later 
indicate that as a group they resembled 
the maladjusted much more than the nor- 
mal subjects. Both of these groups were 
selected in order to match Allen’s group 
most closely so far as age and IQ were 
concerned. The MHC neurotic group 
consisted of 50 veterans who had made 
application for and had received treat- 
ment in a Veterans Administration men- 
tal hygiene clinic, where they had been 


TARLE 2. 


diagnosed as anxiety tension state. These 
cases were selected at random. The mean 
age and mean IQs for all groups will be 
found in Table 1. For every group ex- 
cept Rapaport’s, the N equals 50, and in 
Rapaport’s, the N equals 49. 


RESULTS 


The basic data are presented in Table 
1. The first row is reproduced from Al- 
len‘), and the second row from Blake 
and McCarthy“). These data are in line 
with other studies on the MDI; Garfield 
and Fay“ and Magaret and Simpson“) 
who studied the relationship between the 
Wechsler-Bellevue MDI and the Shipley- 
Hartford CQ for patients with various 
diagnoses report 21% and 14%, respec- 
tively, of their patients had MDI’s of 
over 20%. 

Table 1 shows consistent differences on 
the one hand between Allen’s group of 
the brain injured, and the two normal 


Comparison of the significance of the difference between the groups 
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COMPARATIVE EVALUATION 


TABLE 3. 


Use of a critical score of 10 to differentiate groups 








Less than 10 


Subjects 


N 


10 or more 


Jo 


Approx. 


ratio 


Te 





Blake & McCarthy 
Rapaport 

VCS Non-Neurotic 
VCS Neurotic 
MHC Neurotic 
Kogan Schizophrenic 


14 
38 
36 
26 
29 
24 


27 


28 72 
7 24 
27 
48 
42 
52 
46 





groups (Blake and McCarthy, Rapaport). 
On the other hand, the brain injured 
group also shows consistent differences 
from the other four categories. In short, 
the brain injuries seem to fall in a special 
category. This is illustrated by Table 2, 
showing the P values for the ,x* scores. 
So far as Allen’s group is concerned, it 
differs at the 1% level of confidence from 
the normal groups, and at levels of confi- 
dence from 2% to 10% from the other 
groups. 

It is interesting that the normal groups 
do not differ at all from each other, but 
that both of them differ markedly from 


all the other groups, ranging from the 2% 


to 10% level of confidence. The four 
“maladjusted” groups when compared 
with each other by the x? method, indicate 
that the hypothesis that the differences 
between them are due to chance must be 
retained. Apparently, then, the specific 
type of diagnosis does not matter; with 
maladjustment the MDI goes up. 

Blake and McCarthy point out that the 
practical efficiency of the MDI may be 
considered, using a score of 10 as a criti- 
cal score rather than the 20% criterion 
usually described. Using this score (see 
Table 3) they find the ratio of correct 
classification to error is approximately 3 
to 1 for both the brain injured and the 
normal subjects. Thus, they find that 
only 26 of the 100 subjects would be in- 
correctly classified, while 74 would be ap- 
propriately designated. For our addi- 
tional normal group (Rapaport) this 
ratio holds true; only 27% would be in- 
correctly classified. However, when we 
apply this technique to those groups with 
functional disorders, we find that it is no 
better than chance and that for each of 
the four groups, approximately half of 


the patients would be incorrectly classi- 
fied, so that while this index has some 
value in differentiating the brain injured 
from the normals, it has no value in 
differentiating the brain injured from 
subjects with functional disorders. 
Wechsler“ has indicated that 10% to 
20% losses are roughly equivalent to 1 
and 2 PE from the mean, but he fails to 
offer any evidence in support of this. If 
this is so, then we can expect our normal 
groups to fall roughly in the same pat- 
tern. The x? (see Table 2) was com- 
puted comparing each of the groups with 
the assumed normal distribution of 
MDI’s. These results indicate that the 
probabilities of the differences being due 
to chance were .70 and .50 for the normal 
groups; .10 for the two VCS groups and 
the schizophrenic group, and at the 1% 
level of confidence for the MHC neurotic 
and the brain injured. It would appear 
then that the MDI’s for the normal sub- 
jects do not differ from the standardiza- 
tion group, that the chances are 9 out of 
10 that the difference found for the VCS 
groups and the schizophrenics are not 
due to chance, and the differences found 
for the neurotics and the brain injured 
are significantly different from chance. 


SUMMARY 


1. The MDI’s for the following seven 
groups of subjects were compared: brain 
injured, applicants for vocational counsel- 
ing with psychoneurotic diagnoses, and 
with other than psychoneurotic diagnoses, 
mental hygiene clinic patients diagnosed 
as anxiety tension state, mental hygiene 
and hospital patients diagnosed as schizo- 
phrenic, and two groups of normals. 

2. This report agrees with a previous 
study in that the brain injured subjects 
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differ as a group from the normal. The 
brain injured group also differs from all 
the other groups except the anxiety ten- 
sion state groups to a significant degree. 
In general, the two well adjusted groups 
differ from all the other groups signifi- 
cantly (except in one instance) but are 
themselves similar. While the four mal- 
adjusted groups differ from both the brain 
injured, and the well adjusted, they show 
a high degree of similarity to each other. 

3. When a critical score of 10 for the 
MDI is used, this criterion will correctly 
classify approximately 75% of the sub- 
jects, when only the brain injured and the 
normal groups are considered. However, 
for the other four groups, the results are 
no better than chance; approximately 
50% of each group would be incorrectly 
classified. 

4. It was fourd that the MDI’s for the 

normal subjects did not differ to a degree 
greater than that expected by chance from 
a normal distribution of MDI’s. This 
supports Wechsler’s contention _ that 
MDI's are distributed along a normal 
curve with 10% and 20% at 1 PE and 2 
PE from the mean, respectively. 
5. Magaret‘?) said at the conclusion of 
one of her studies of the Wechsler-Belle- 
vue, “The only conclusion warranted is 
that certain tests of the scale are sensitive 
to whatever changes in the organism 
which occur similarly in schizophrenics, 
general paretics, and old age.” To which 
we might add the additional categories 
of the brain injured and the neurotic and 
the maladjusted individuals, in so far as 
the change is measured by the MDI. 


1. 


S. ROGERS 
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A NOTE ON ALLEN’S INDEX OF DETERIORATION* 


LAWRENCE S. ROGERS 


Veterans Administration Mental Hygiene Unit, Denver, Colorado 


Allen recently suggested a new in- 
dex to replace the Mental Deterioration 
Index (MDI1)* of the Wechsler-Belle- 
vue. He suggests computing the differ- 
ence between the sum of the Information 
and Comprehension weighted scores and 
the Digit Span and Digit Symbol weighted 
scores. A difference of five or more 


TABLE 1. Classification of subjects using Allen’s Index 


state patients. A total of 349 subjects 
were used in this study. In this connec- 
tion Allen’s index was also computed and 
the results are shown in Table 1. It was 
found that the approximate ratio of cor- 
rect to incorrect classification for normal 
subjects was 3:1 using as a critical score 
an MDI of 10%, This ratio fell to 2:1 


Less than 5 


N % 


5 or more 





Blake & McCarthy (Normal) 
Rapaport (Normal) 

VCS (Non-Neurotic ) 

VCS (Neurotic) 

MHC (Neurotic ) 

Kogan (Schizophrenic ) 





33 66 
32 65 
29 58 
28 56 
21 42 
29 58 





points he considers as being suggestive of 
brain injury. He did not compute an in- 


dividual index for each of his own pa- 


tients, but derived it from his table of 
mean subtest scores for brain-injured pa- 
tients. 

Blake and McCarthy) using Allen’s 
proposed index with normal subjects 
found it would not be more desirable than 
the MDI since “it would result in an in- 
crement in the amount of classification 
error with normal subjects.” The pres- 
ent author“? recently reported a study on 
the MDI with normal subjects, appli- 
cants for Vocational Rehabilitation both 
with the diagnosis of neurosis or with 
diagnoses other than neurosis, with 
schizophrenics, and with anxiety tension 

*Published with the permission of the Chief 
Medical Director, Department of Medicine and 
Surgery, Veterans Administration, who as- 
sumes no responsibility for the opinions ex- 
pressed or conclusions drawn by the author. 

* All MDI’S are corrected for age. 


using Allen’s index. For the various 
types of maladjusted subjects neither in- 
dex could produce more than a 1: 1 ratio. 

In summary our results confirm those 
of Blake and McCarthy. Allen’s index 
would be somewhat less discriminative 
than the MDI so far as normal subjects 
are concerned. Neither index produces 
significant results with maladjusted 
groups. 
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EDITORIAL OPINION 





This Journal is gratified to have the 
opportunity to publish the complete Sym- 
posium on Psychology in the Field of 
Community Services presented in Sep- 
tember 1949 at the Denver meeting of the 
American Psychological Association. The 
fact that such a symposium was scheduled 
gives indication of the increasing aware- 
ness of the potential contributions of scien- 
tific psychology to community planning 
and service. In a world unsettled by the 
Four Horsemen of the Apocalypse, and 
threatened by the still more dreadful spec- 
tre of atomic warfare, our best hope for 
preventative measures seems to come from 
the promise of the psychological and so- 
cial sciences which have temporarily been 
eclipsed by the spectacular accomplish- 
ments of the physical sciences. One of 
the ideas suggested by all the papers of 
this symposium is that psychology as sci- 
ence will have failed to live up to its 
potential contribution until it begins to 
make important practical contributions to 
the group dynamics of everyday living. 
Important though science may be for its 
own sake, will it not be ultimately sterile 
if it fails to save the world from the mad 
whirl of aggression and destruction which 
we are now witnessing? Probably the 
greatest need of civilization is for the 
rapid and effective dissemination of psy- 
chological principles in the conduct of its 
affairs, but how is psychological science 
to accomplish this end? 

The current impotence of scientific or 
applied psychology may be illustrated by 
examples all the way from family life to 
world politics. Although the current war 
of nerves being conducted between the 
East and the West undoubtedly involves 
effective psychological principles, it is to 
be regretted that the negative emotions of 
fear and hate appear to be the basic 
weapons in a cat-eat-dog, eye-for-an-eye 
conflict. To be certain the Western pow- 
ers visualize themselves as being more 
Christian and enlightened, but there is no 
certainty that the concepts of pacifism and 
forgiveness will be effective in preventing 
another catastrophe. One of the most 


profitable research investigations which 
could be conceivably made might be the 
study of how psychological scientists could 
gain a hearing for themselves, i.e., how to 
intervene potently. 

One of the first problems encountered 
by the psychologist entering the field of 
community service either on local or inter- 
national levels is the fact that others are 
already in administrative control of the 
situation. Most community affairs are 
currently being run by people who by vir- 
tue of experience and power feel that they 
know best how to do things. Indeed, the 
psychologist is a belated comer to the field 
who will probably find himself equally ill 
at ease whether he attempts to help in the 
affairs of a village or on the international 
stage. Perkins is correct when he stresses 
the fact that the psychological scientist 
should enter the scene as a “listener and 
learner.” He will soon learn that his 
psychological learning has relatively little 
to do with the problem of how to raise 
wages, improve working conditions, and 
provide community resources for dealing 
with mental hygiene problems. In fact, 
many of the laymen with whom he will 
have to work will turn out to be extremely 
shrewd citizens who are masters of the 
practical psychology otf the local situation. 
The psychologist can expect that his train- 
ing and academic prestige will cut little 
ice unless he can overcome the natural 
suspicion of the layman for “long-hairs” 
and actually make himself felt in terms of 
effective performance. The first step in 
accomplishing this is simply to be around 
long enough for people to become accus- 
tomed to the presence of a psychologist in 
their midst. During this initial getting- 
acquainted process the psychologist should 
tread softly since there will be many in- 
secure people who will feel threatened by 
their belief that he can read their minds, 
and otherwise recognize them as mentally 
unfit or disordered. Above all should the 
psychologist not be led into trying to 
“over-sell” himself because of his own 
feelings of insecurity. 

One of the first reactions commonly ex- 
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perienced by the apprentice psychological 
or social worker is a feeling of disgust or 
revulsion on discovering just how bad 
some conditions are. Whenever a new wel- 
fare service enters a community, there are 
immediately referred to it a collection of 
community “sores” and human derelicts. 
Typical problems include the alcoholic 
pauper with 18 children who only stops at 
home long enough to beget another, the 
mentally defective family which has been 
the town’s chief welfare burden for the 
last 75 years, the urban or rural slums 
from which comes most of the delinquen- 
cy, and the incestuous parent or sex crimi- 
nal who has been sent away several times 
only to be pardoned so as to repeat his 
offenses. The beginner’s first reaction is 
that such conditions are intolerable and 
something must be done right away. Hav- 
ing learned all the answers in school, he 
will usually come up with an expensive 
plan for which there are no resources in 
the community to execute. Being young, 
he may raise such a public furore that 
some community agency is stimulated to 
make abortive efforts to resolve the situa- 
tion but these are usually destined to 
failure because the community as a whole 
has neither the insight nor the resources to 
carry them out. Too often, this dramatic 
publicity only succeeds in making the citi- 
zenry feel uneasy at having its dirty linen 
washed in public with the result that the 
clamor soon dies down and the welfare 
enthusiast finds that he has lost his use- 
fulness by accomplishing no more in the 
end than many other zealots before him. 

Zander makes a most important point 
in this symposium when he calls for a 
coordinated research program to tackle 
the problem of how best to organize men- 
tal hygiene preventative services. Such a 
program must function at all levels from 
the selection of students in universities, 
to the planning of training programs, and 
to the practical details of how to put an 
effective program across in the communi- 
ty. A most important advance would be 
made if every psychologist made himself 
a committee of one to actively participate 
in the affairs of his community and to 
make whatever contribution he could. 
Perhaps we psychologists do not know 
the answers at the present time, but at 


least no other group in the community 
has comparable academic and _ research 
training in problems of interpersonal re- 
lations. Such a program would not only 


make a contribution to community serv- 
ices, but it would also improve the psy- 
chologist’s own practical abilities and give 
him some first hand experience of what 
the problems actually are. 


F.C.T, 
1 

The status of research evaluations of 
the results of counseling and psychother- 
apy would be materially advanced if ade- 
quate attention was given in research plan- 
ning to problems of diagnosis. It is obvi- 
ous that no rational evaluation of thera- 
peutic results can be achieved in the ab- 
sence of knowledge concerning the nature 
of the pathological process which it is 
intended to modify. Without a valid diag- 
nostic formulation it is even impossible 
to state that any discernible pathological 
state actually exists. Similarly, without 
diagnostic information concerning — the 
type of case material dealt with, it is im- 
possible to reproduce the conditioris of the 
experiment elsewhere or even to analyze 
the results. All sorts of therapeutic 
claims may be made if the nature of the 
case material is unknown. In other words, 
failure to make adequate diagnostic 
studies may completely invalidate re- 
search results because of failure to identify 
and control the variables involved. 

Medical history yields pertinent analo- 
gies on the difficulties of assaying thera- 
peutic claims and also indicates possible 
avenues of solution. A good example of 
how medical research has handled the 
comparative study of different methods of 
therapy is the problem of whether X-ray 
or surgery is the method of choice in treat- 
ing certain types of cancer. For years con- 
troversies raged in support of either meth- 
od with entirely confusing and inconclusive 
results. The inconsistency of results was 
caused by the failure of research planning 
to conduct sufficiently detailed diagnostic 
studies to control the sampling of cases 
adequately. Failure to differentiate be- 
tween various degrees of malignancy of 
the tumors resulted in the attempt to re- 
late incomparable groups, e.g., one study 
reported results with cases of low malig- 
nancy while another research studied cases 
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of high malignancy with entirely different 
results. 

In order to make an exact differentia- 
tion of the case material under study, it 
is necessary not only to differentiate the 
nature of the pathological process but also 
its malignancy. Assuming that current 
diagnostic categories are reasonably satis- 
factory in differentiating the various clini- 
cal syndromes, attention may be given to 
quantification of the degree of malignancy. 
It would seem desirable to use the follow- 
ing criteria for estimating malignancy : 


Pathogenicity of the etiologic factors. 
Organicity. In general, organic dis- 
orders are more malignant than func- 
tional. It is of course important to 
differentiate between the malignancy 
of different organic disorders. 
Chronicity. In general, the prognosis 
becomes worse with increasing chro- 
nicity. 

Direction of Change. Increasing se- 
verity of incapacitation is an undesir- 
able sign. 

Client Resources. The greater the 
personality resources, the better the 
prognosis. 

6. Client Insight. Lack of client insight 
isa poor prognostic sign. 


l. 
2. 


For a valid research plan, it would appear 
necessary to make refined enough diag- 
nostic studies in order to differentiate the 
nature and malignancy of the case mate- 
rial studied. 

This issue contains a solicited evalua- 
tion by Albert Ellis of the nondirective 
research project “A Coordinated Research 
in Psychotherapy” appearing in the June 
1949 issue of the Journal of Consulting 
Psychology. In our opinion, the view- 
point of the nondirective group that ade- 
quate diagnostic studies are unnecessary 
for effective therapeutic results has largely 
vitiated the validity of most of the re- 
search thus far published in support of 
the nondirective method. In the absence 
of careful diagnostic studies of the case 
materials, or at least descriptions of the 
presenting complaints with psychological 
appraisals of the personalities involved, we 
are unable to tell enough about the nature 
of the case material to draw any conclu- 
sions. Unless the fact of disorder and its 
malignancy is established, it is only safe 
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to conclude that these cases either had no 
significant personality problems or else 
that they were of very superficial nature 
which almost any method might cure. It 
will not be possible to evaluate the results 
from any method of counseling and psy- 
chotherapy until valid research planning 
is achieved. FOF. 
7 


The June 1949 issue of the American 
Psychologist contains a report by Keller 
and Schoenfeld about a new psychology 
curriculum at Columbia College. Because 
of the prestige of the Columbia depart- 
ment and the influence which it has tradi- 
tionally carried in American psychology, 
it appears necessary to evaluate the new 
curriculum with particular reference to its 
possible effect upon the healthy develop- 
ment of clinical psychology. In order to 
understand the historical antecedents of 
this new approach, it may be remembered 
that for many years the Columbia depart- 
ment has been a stronghold of Behavior- 
ism and “objective” psychology in the 
sense that its orientation was preoccupied 
with “pure” science and experimentalism. 
Since only the simpler mental processes 
were amenable to brass-instrument ex- 
periments, there has been a tendency at 
Columbia to avoid the study of the organ- 
ism at the highest levels of function, i.e., 
the whole individual meeting its complex 
environment. Clinical psychology has 
never gained a respectable foothold either 
in Columbia College or the graduate de- 
partment but has been delegated to Teach- 
ers College. After World War I there 
were several flickerings of interest in clini- 
cal psychology in individual staff members 
but they were never allowed to develop 
their plans, hence the Columbia depart- 
ment has never developed clinics and other 
facilities for securing case materials for 
research and teaching purposes. The re- 
sult has been that generations of Columbia 
students have obtained the highest grad- 
uate degrees without ever having come 
face-to-face with a single human case for 
the purpose of making an intensive per- 
sonality study. Columbia graduates are 
unquestionably well trained in experi- 
mentalism and research technique but 
their training which was largely con- 
cerned with basic process and “rat psy- 
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chology” had large blind spots relating 
to problems of total personality. In justi- 
fying the narrowness of this outlook, the 
Columbia staff has argued that the stu- 
dent who was well trained in basic re- 
search was automatically well equipped 
to enter any other field. The validity of 
this opinion has for years been questioned 
by a number of graduates who have been 
professionally handicapped by lack of spe- 
cialized training particularly in the field of 
“the whole individual in action.”  Per- 
sonally, we believe that it is unwise on 
both philosophical and scientific grounds 
for any university department to subscribe 
to any “systematic” viewpoint whether it 
be Behaviorism or psychoanalysis. 

In our opinion, any broad educational 
program in psychology must represent a 
compromise between many objectives, not 
the least of which is to give the beginning 
student enough of the applied psychology 
of everyday living so that he is able to 
understand the potential contribution of 
psychology to civilized living and to solve 
his own personal problems. It must be 
clearly recognized that very few college 
students will ever become research scien- 
tists nor is it desirable to give them inten- 
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sive training in basic science at the ex- 
pense of applied psychology. Even more 
on graduate levels of instruction is it un- 
wise to largely ignore such important 
areas as that of clinical psychology. Very 
few students can predict the direction of 
their later interests. Nor can a depart- 
ment limit itself to the production of “sci- 
entists.” We believe that the current 
fashion of distinguishing between “pure” 
and “applied” scientists is spurious and 
artifactual. The psychologist of the future 
must be well-rounded. In order to accom- 
plish this, training programs must be gen- 
uinely broad, covering both basic and ap- 
plied science. We question very seriously 
whether a curriculum oriented at the level 
of the rat can qualify as being genuinely 
broad. We can conceive that some stu- 
dents passing through the type of curricu- 
lum outlined by Keller and Schoenfeld 
might come out with a broad viewpoint 
but if such occurred it would be in spite 
of the type of training offered. The bril- 
liant student will always explore human 
knowledge for himself in spite of the “sys- 
tematic” viewpoint of his teachers. To 
us, such a program represents a regression 


rather than an advance. F.CT. 
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SynGG, DONALD and Coss, ArTHUR W. 
Individual behavior. New York: Har- 
per, 1949, pp. 386. $3.50. 

This is a timely, well-written, and inter- 

esting book to which no brief review can 

possibly do justice. Its main strengths 
and weaknesses, therefore, will be sum- 
marily outlined. First, as to strengths: 


1. It presents a consistent, if at times 
oversimplified and almost glib, picture 
of the human organism psychologically 
reacting with its environment; and it 
does so without the obnoxious folk- 
lore, dogmatism, and mystical attitudes 
of many orthodox psychodynamic 
writers. 

It re-emphasizes, with logical per- 
suasiveness, the vital importance of 


studying human behavior and its dis- 
orders from the frame of reference of 
the patient rather than from arbitrary 
external frames of reference. 

It ably shows how individual frames 
of reference may be valuably applied 
to problems of conditioning, school 
learning, perception, and other fields 
of psychological study which have up 
to now been too externalized in their 
approach. 

Clinically, it places a justifiable em- 
phaiss on the patient's attitudes 
towards his environment, his prob- 
lems, and his general behavior rather 
than only on his behavior itself. 

Its chapters on education and teach- 
ing are particularly good in that they 
ask the pertinent question: Education 














BOOK REVIEWS 


for what? and unequivocally answer : 
For the development of each child's 
“maximum potentialities as an individ- 
ual and a citizen” (p. 224). 

Unlike most contemporary non-direc- 
tively oriented writing, it is sufficiently 
broadminded to leave a place, albeit 
an underemphasized one, for diagno- 
sis, case history taking, and even di- 
rect manipulation of the patient’s en- 
vironment. 


Some of the main weaknesses of Indi- 


vidual behavior are these: 


1. 


It gives an impression of more origi- 
nality than it actually posessses. Al- 
though its expression of psychody- 
namic theory is novel, it adds little 
new knowledge of human behavior, 
and few very deep or penetrating for- 
mulations are presented. The phe- 
nomenological approach has apparent- 
ly failed to reach, as yet, the depth 
analysis of the psychoanalytic pioneers 
on whose discoveries Snygg and 
Combs so fundamentally rely. 

The constructs employed by the 
authors, while simpler, probably more 
scientific, and certainly more in line 
with conventional psychological think- 
ing and terminology than many of the 
constructs and myths of orthodox ana- 
lytic theory, are still hypotheses which 
seem to be at least one step removed 
from clinical observations. Phenom- 
enal field and phenomenological self 
are more operationally definable and 
easier to work with than ego, id, and 
superego; but they still seem to be 
redundant, highfaluting approxima- 
tions for the human organism and the 
external world. Thus, Snygg and 
Combs state that “All behavior, with- 
out exception, is completely deter- 
mined by and pertinent to the phenom- 
enal field of the behaving organism. 
By phenomenal field we mean the en- 
tire universe, including himself, as it 
is experienced by the individual at the 
instant of action” (p. 15). What this 
seems to mean, more simply stated, is 
that all human behavior is determined 
by (a) the human individual interact- 
ing with (b) the outer world. The 
ten-dollar terms, p/enomenological 


self and phenomenal field, so reitera- 
tively employed by the authors, seem 
to add nothing but some degree of 
sematic difficulty and obfuscation. 
The weakest section of the volume is 
that concerned with therapy—which 
contains nearly all the contemporary 
biases and limitations of the non- 
directive viewpoint. While ably point- 
ing out ‘the value of non-directive 
techniques for some disturbed indi- 
viduals, the authors imply (a) that 
these techniques are effective with vir- 
tually all types of patients; (b) that 
they are more effective with all pa- 
tients than all other forms of therapy ; 
and (c) that there are no patients who 
do not have powers of self-recovery 
right at their fingertips if only they 
are non-directively counseled. Fortu- 
nately, the main arguments of the vol- 
ume do not stand or fall with the 
authors’ non-directive applications. 
But the danger is that many unsophis- 
ticated students of psychology who 
come to have faith in the authors’ main 
theories may blindly follow their su- 
perficial and inadequate treatment of 
the therapeutic process. 

The volume frequently sets up straw- 
men of “externalists,” “inductionists,” 
and other psychologists who are ac- 
cused of completely ignoring, or even 
sabotaging, the private worlds of nor- 
mal human beings, and of acting in a 
thoroughly non-scientific manner in 
which, in fact, virtually no contem- 
porary psychologists seem to act. 
Individual behavior is clinically weak 
at several points. Thus, it speaks 
about phobias as if they were clearly 
differentiated from neuroses (p. 159) ; 
it describes as “manic depression” 
what seems to be a fairly clear-cut case 
of reactive depression (p. 168); and 
it implies that delusions of grandeur 
are intrinsic only to hebephrenic, and 
not to paranoid, schizophrenic states 


(p. 174). 


In conclusion, Snygg and Combs’ /ndi- 
vidual behavior consists of interesting and 
intelligent reformulations of many psycho- 
dynamic viewpoints ; and while it is hardly 
a definitive volume on human behavior and 
therapy, it is well worth the serious, and 
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it is to be hoped critical, consideration of 
clinical psychologists. ALBERT ELLIS 


Sarason, Seymour B. Psychological 
problems in mental deficiency. New 
York: Harper, 1949. Pp. 366. $5.00. 

Dr. Sarason is Associate Professor of 
Psychology at Yale University and for- 
merly psychologist at the Southbury 
(Conn.) Training School for mental de- 
fectives. There has long been need for a 
scientifically oriented textbook in the field 
of mental deficiency. This book eminent- 
ly satisfies the need. It is readable, up-to- 
date and with a judicious selection of re- 
search reports. Of particular value are 
the detailed discussions of the handling of 
mental defectives. 


Wa tin, J. E. WALLACE. Children with 
mental and physical handicaps. New 
York: Prentice-Hall, 1949. Pp. 549. 
$5.00. 

Dr. Wallin is one of the pioneers in 

America in the field of special education. 

His authoritative textbook will probably 

supplant Tredgold’s classic work on men- 

tal deficiency. 


Bripce, Epwarp M. Epilepsy and con- 
vulsive disorders in children. New 
York: McGraw-Hill, 1949. Pp. 670. 
$8.50. 

Dr. Bridges is Research Professor of Pe- 
diatrics, School of Medicine, University 
of Buffalo. This is a broad reference 
textbook covering all aspects of convul- 
sive disorders, Its orientation is thor- 
oughly scientific in all respects. 


Wain, J. E. Wattace. Personality 
maladjustments and mental hygiene. 
New York: McGraw-Hill, 1949. Pp. 
581. $5.00. 

This is the second edition, completely re- 
vised and enlarged, of Dr. Wallin’s well- 
known text. Appropriate for undergrad- 
uate and elementary graduate courses in 
mental hygiene, it is very well documented 
and easily readable. 


LEMKAU, PAUL V. 
public health. 
Hill, 1949. Pp. 396. $4.50. 

Dr. Lemkau is Associate Professor of 

Public Health Administration at Johns 


Mental hygiene in 
New York: McGraw- 
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Hopkins University. He discusses the 
practical public health problems concerned 
with establishing mental hygiene pro- 
grams for all periods of life. 


Sopen, WittiAM H. Rehabilitation of 
the handicapped. New York: Ronald 
Press, 1949. Pp. 399. $5.00. 

Mr. Soden is Executive Assistant, Physi- 
cal Medical Rehabilitation Service, Veter- 
ans Administration Hospital, Northamp- 
ton, Mass. The book discusses general 
medical and surgical, neurological, psy- 
chiatric, vocational, social, educational and 
psychological trends in rehabilitation of 
the handicapped. 


Wever, Ernest G. Theory of hearing. 
New York: Wiley, 1949. Pp. 484. 
$6.00. 

Dr. Wever is Professor of Psychology at 

Princeton University and a pioneer re- 

searcher in the field of hearing. This is 

probably the most authoritative reference 
work in this field available today. 


CHapanis, A., GARNER, W. R. and Mor- 
GAN, C. T. Applied experimental psy- 
chology. New York: Wiley, 1949. Pp. 
434. $4.50. 

The authors are all members of the psy- 

chology department at Johns Hopkins 

University. It reviews experimental find- 

ings related to the human factors in engi- 

neering design. 


Cavan, R. S., Burcess, E. W., Havic- 
HuRsT, R. J. and GotpHAMER, H. Per- 
sonal adjustment in old age. Chicago: 
Science Research Associates, 1949. Pp. 


204. 


This is the report of a study conducted by 
a committee on Social Adjustment and 
Old Age supported by the Social Science 
Research Council on a group of 2,988 


older persons. Methods and results of 
research approach are discussed. 


FREUD, SIGMUND. An outline of psycho- 
analysis. New York: Norton, 1949. 
Pp. 127. $2.00. 


This is the first English translation in 
book form of Freud's last book written in 
1938. It is a brief resume of the princi- 
ples of psychoanalysis. 
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ALEXANDER, FRANZ. Fundamentals of 
psychoanalysis. New York: Norton, 
1949, Pp. 312. $3.75. 

This book represents a revision of por- 
tions of The Medical Value of Psycho- 
analysis reviewing the basic concepts of 
psychoanalysis. It includes a theoretical 
refinement of the integrative functions of 
the ego in terms of the stability principle 
of Freud, the inertia principle and the 
principle of surplus energy. 


Various Epitors. The psychoanalytic 
study of the child. Vols. 3-4. New 
York: International Universities Press. 
1949. Pp. 493. $10.00. 

This volume includes a selection of origi- 

nal psychoanalytically-oriented studies on 

the child. 


MoLoney, JAMES CLARK. The magic 
cloak. Wakefield ( Mass.) : Montrose 
Press, 1949. Pp. 345. $5.00. 

This is a collection of essays by a psy- 

chiatrist of wide experience. The subject 
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matter includes anecdotes from his work 
and personal reflections on psychiatric and 
psychoanalytic matters. 


RAMBERT, MADELEINE L. 
conflict. New York: 
Universities Press, 1949. 
$3.25. 

This is a popular book for parents and 

teachers summarizing 12 years of psycho- 

analytic practice. 


Children in 
International 
Pp. 214. 


HILLrern, E. P., SPAULDING, I. A. 
HILLPeRN, E. P. 
American Negro. New York: Hermi- 
tage Press, 1949. Pp. 184. $3.00. 

This is a psychoanalytic case history writ- 

ten in prose style. 


and 
Bristow Rogers: 


Fopor, NANDoR. The search for the be- 
loved. New York: Hermitage Press, 


1949. Pp. 400. $5.00. 
This is an analytically oriented attempt to 
trace the effects of the birth trauma in 
man. Some case material is given with 
author’s interpretations. 
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Clinical Psychology Monographs 


FOR CLASS USE 





MONOGRAPH No. 1. January 1948 Price $.90 


THE BENDER-GESTALT: AN OBJECTIVE SCORING 
METHOD AND VALIDATING DATA. 


Fred Y. Billingslea, Tulane University 
This monograph must be ordered direct from Dr. Fred Y. Billingslea, 
Psychology Department, Tulane University, New Orleans, La. 


MONOGRAPH No. 2. April 1948 Price $1.25 


A MANUAL ON QUALITATIVE ASPECTS OF PSYCHO- 
LOGICAL EXAMINING. 


Jerry W. Carter, Jr. por J. W. Bowles, Jr. 
Wichita Guidance Center University of Wichita 


MONOGRAPH No. 3. July 1948 Price $1.50 


TRAINING IN CLINICAL PSYCHOLOGY. Transactions 
of Josiah Macy, Jr. Foundation Conference. 


MONOGRAPH No. 4. July 1948 Price $1.25 


SYMPOSIUM: CRITICAL EVALUATION OF NONDIRECTIVE 
COUNSELING AND PSYCHOTHERAPY. 


MONOGRAPH No. 5. October 1948 Price $2.00 


THE H-T-P TECHNIQUE. QUALITATIVE AND QUANTI- 


TATIVE MANUAL. 
John N. Buck, Lynchburg State Colony 


MONOGRAPH No. 6. July 1949 Price $2.00 


OBJECTIVE PSYCHOTHERAPY 
Ben Karpman, M.D. 


MONOGRAPH No. 7. January 1950 Price $2.00 
STATISTICS FOR THE CLINICIAN 





Order From 


JOURNAL OF CLINICAL PSYCHOLOGY 
BRANDON, VERMONT 
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REGISTRATIONS NOW BEING ACCEPTED 


Champlain Workshops 


During the Summer of 1950, a series of Vacation Workshops in Clinical 
Psychology will be held at Grand Isle, Lake Champlain, Vermont. These 
Workshops are designed to provide intensive explorations in areas of Theory 
and Practice which have not been extensively covered in the literature. 
The Workshops will be under the direction of Frederick C. Thorne, M.D., 
Ph.D. Two courses will be presented in 1950: 


I. DIAGNOSTIC PROBLEMS IN COUNSELING AND PSYCHOTHERAPY. 
This Workshop will deal with specific types of diagnostic problems encoun- 
tered in the standard categories of disorders. Special emphasis will be placed 
on the indications for utilizing the various methods of therapy. 


II. COUNSELING PROBLEMS RELATING TO INTERPERSONAL MAL- 
ADJUSTMENTS. This Workshop will explore the most common causes 
for interpersonal difficulties with reference to diagnosis and therapy. 


GENERAL INFORMATION 


PLACE. The Workshops will be held at Grand Isle, Vermont. Grand Isle is an historic island 
thirteen miles long lying in the middle of the northern end of Lake Champlain. This unspoiled 
country is among the prettiest in New England with spectacular views and provision for all 
summer sports. It may be reached via the Rutland Railroad from New York or by U. S. Route 2. 


SCHEDULE. The Workshops will be confined to morning hours from 8:30 A.M. to 12:30 P.M. 
from Monday through Saturday. There will be approximately 25 hours of intensive work and 
discussion in each Workshop. The afternoons will be left free for rest or recreation. 


DATES. Final dates will depend upon convenience of registrants. Tentative dates are: Course I, 
June 19-24, July 17-22 or August 21-26. Course II, June 26-July 1, July 24-29 or August 28- 
September 2° Please indicate preference when registering. 


REGISTRATION. Will be limited to ge pe psychologists and students beyond the level of 
the Master’s degree. It is expected that each registrant will have had sufficient clinical experience 


to be able to contribute to the Workshop. Only a limited number will be accepted at each 
Workshop. 


FEES. A fee of $25.00 will be charged for each apa payable in advance. This payment will 
insure a reservation. Registrants should apply early. 


ACCOMMODATIONS. Several high quality hotels, boarding bain and tourist camps are adjacent 
to the site of the Workshop. Room and board may be obtained at from $5.00 per day up. The 
——- i. assume responsibility for locating accommodations for everyone. Please indicate 
type desired. 


CHAMPLAIN WORKSHOPS 
Box 184 
BRANDON, VERMONT 
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For Your Patients 
who are Girls and Boys with 


@ Normal Intelligence but Emotional Disorders 
@ Specific Educational Disabilities 
@ Slow-learning Skills 


@ Behavior Difficulties 


— Devereur (amps 


RECREATIONAL EDUCATIONAL THERAPEUTIC 
Operated by the Devereux Schools, Santa Barbara, California; Devon, Pennsylvania 
Separate camps for different age groups on beautiful Lake Embden, 
North Anson, Maine. Water and land sports: swimming, canoeing, 
boating, tennis, riding, camp crafts, overnight hikes, partial academic 
program. 


Schedule includes individual study and personality evaluation for 
each new camper. The intensive summer training aims to promote 
maturity and to prepare campers for their fall environment. Guid- 
ance for the next step in the child’s life is given by the professional 
staff. 


Recent additional accommodations will afford these facilities, in 
the summer of 1950, for students now attending other schools. 


HELENA T. DEVEREUX 


Director 
JoHNn M. Barciay, Registrar 
Address: Charles J. Fowler, Assistant Registrar, Devereux Schools, 
Devon, Pa. 














